-- Logs begin at Thu 2022-06-16 11:46:46 UTC, end at Thu 2022-06-16 12:52:26 UTC. -- Jun 16 12:17:52.830481 dv-cinder-846149-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 16 12:17:52.839641 dv-cinder-846149-2-iscsi devstack@n-api.service[103039]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 16 12:17:52.841600 dv-cinder-846149-2-iscsi devstack@n-api.service[103039]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 16 12:17:52 2022] *** Jun 16 12:17:52.841600 dv-cinder-846149-2-iscsi devstack@n-api.service[103039]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 16 12:17:52.841600 dv-cinder-846149-2-iscsi devstack@n-api.service[103039]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 16 12:17:52.841600 dv-cinder-846149-2-iscsi devstack@n-api.service[103039]: nodename: dv-cinder-846149-2-iscsi Jun 16 12:17:52.841600 dv-cinder-846149-2-iscsi devstack@n-api.service[103039]: machine: x86_64 Jun 16 12:17:52.841600 dv-cinder-846149-2-iscsi devstack@n-api.service[103039]: clock source: unix Jun 16 12:17:52.841600 dv-cinder-846149-2-iscsi devstack@n-api.service[103039]: pcre jit disabled Jun 16 12:17:52.841600 dv-cinder-846149-2-iscsi devstack@n-api.service[103039]: detected number of CPU cores: 4 Jun 16 12:17:52.841600 dv-cinder-846149-2-iscsi devstack@n-api.service[103039]: current working directory: / Jun 16 12:17:52.841600 dv-cinder-846149-2-iscsi devstack@n-api.service[103039]: detected binary path: /usr/bin/uwsgi-core Jun 16 12:17:52.842370 dv-cinder-846149-2-iscsi devstack@n-api.service[103039]: your processes number limit is 47680 Jun 16 12:17:52.842370 dv-cinder-846149-2-iscsi devstack@n-api.service[103039]: your memory page size is 4096 bytes Jun 16 12:17:52.842370 dv-cinder-846149-2-iscsi devstack@n-api.service[103039]: detected max file descriptor number: 2048 Jun 16 12:17:52.842370 dv-cinder-846149-2-iscsi devstack@n-api.service[103039]: lock engine: pthread robust mutexes Jun 16 12:17:52.842370 dv-cinder-846149-2-iscsi devstack@n-api.service[103039]: thunder lock: enabled Jun 16 12:17:52.842370 dv-cinder-846149-2-iscsi devstack@n-api.service[103039]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 16 12:17:52.842370 dv-cinder-846149-2-iscsi devstack@n-api.service[103039]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 16 12:17:52.885720 dv-cinder-846149-2-iscsi devstack@n-api.service[103039]: Python main interpreter initialized at 0x556c7af4c9c0 Jun 16 12:17:52.885720 dv-cinder-846149-2-iscsi devstack@n-api.service[103039]: python threads support enabled Jun 16 12:17:52.885720 dv-cinder-846149-2-iscsi devstack@n-api.service[103039]: your server socket listen backlog is limited to 100 connections Jun 16 12:17:52.885720 dv-cinder-846149-2-iscsi devstack@n-api.service[103039]: your mercy for graceful operations on workers is 90 seconds Jun 16 12:17:52.886098 dv-cinder-846149-2-iscsi devstack@n-api.service[103039]: mapped 403077 bytes (393 KB) for 2 cores Jun 16 12:17:52.886181 dv-cinder-846149-2-iscsi devstack@n-api.service[103039]: *** Operational MODE: preforking *** Jun 16 12:17:52.886398 dv-cinder-846149-2-iscsi devstack@n-api.service[103039]: *** uWSGI is running in multiple interpreter mode *** Jun 16 12:17:52.886398 dv-cinder-846149-2-iscsi devstack@n-api.service[103039]: spawned uWSGI master process (pid: 103039) Jun 16 12:17:52.886594 dv-cinder-846149-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 16 12:17:52.887136 dv-cinder-846149-2-iscsi devstack@n-api.service[103039]: spawned uWSGI worker 1 (pid: 103040, cores: 1) Jun 16 12:17:52.887457 dv-cinder-846149-2-iscsi devstack@n-api.service[103039]: spawned uWSGI worker 2 (pid: 103041, cores: 1) Jun 16 12:17:52.888445 dv-cinder-846149-2-iscsi devstack@n-api.service[103039]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 16 12:17:53.547158 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 12:17:53.549990 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 12:17:54.723121 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 12:17:54.723121 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: from cryptography.utils import int_from_bytes Jun 16 12:17:54.723740 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 12:17:54.723740 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: from cryptography.utils import int_from_bytes Jun 16 12:17:54.725358 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 12:17:54.725358 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: from cryptography.utils import int_from_bytes Jun 16 12:17:54.725776 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 12:17:54.725776 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: from cryptography.utils import int_from_bytes Jun 16 12:17:57.291790 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 12:17:57.292460 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 12:17:57.292571 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 12:17:57.292571 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 12:17:57.293011 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 12:17:57.293107 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 12:17:57.293190 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 12:17:57.293190 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 12:17:57.293347 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 12:17:57.293435 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 12:17:57.293526 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.293801 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.293940 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.294145 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.294270 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.294464 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.294569 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.294781 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.294886 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.295093 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.295190 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.295404 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.295500 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.295719 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.295806 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.296033 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.296122 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.296290 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.296387 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.296600 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.296698 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.296912 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.297010 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846149-2-iscsi {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.297231 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.297326 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846149-2-iscsi {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.297537 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.297637 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.297836 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.297967 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.298173 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.298262 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.298481 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.298577 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.298779 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.298875 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.299092 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.299254 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.299394 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.299587 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.299890 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.300029 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.300198 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.300313 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.300499 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.300629 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.300804 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.300930 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.301134 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.301265 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.301444 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.301546 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.301748 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.301837 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.302094 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.302193 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.302400 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.302547 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.302717 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.302812 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.303019 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.303129 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846149-2-iscsi {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.303404 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846149-2-iscsi {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.303494 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.303733 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.304046 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.304166 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.304371 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.304475 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.304682 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.304790 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.305052 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.305735 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.306031 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.306166 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.306309 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.306449 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.306628 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.306717 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.306959 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.307061 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.307265 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.307361 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.307591 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.307686 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.307909 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.308010 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.308217 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.308311 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.308527 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.308617 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.308824 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.308920 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.309130 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.309226 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.309435 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.309534 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.309739 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.309835 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.310015 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.310121 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.310325 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.310422 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.310593 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.310682 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.310898 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.310987 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.311294 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.311382 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.311546 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.311636 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.311802 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.311919 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.312122 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.312222 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.312394 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.312482 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.312708 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.312798 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.313025 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.313116 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.313329 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.313466 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.313634 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.313743 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.313964 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.314081 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.314267 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.314362 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.314568 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.314656 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.314873 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.314962 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.315175 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.315263 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.315477 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.315565 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.315793 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.315883 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.316100 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.316201 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.316417 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.316513 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.316720 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.316808 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.317037 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.317126 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.317342 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.317438 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.317666 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.317765 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.317993 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.318086 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.318306 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.318414 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.318627 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.318731 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.318929 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.319024 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.319239 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.319336 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.319544 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.319633 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.319846 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.319933 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.320150 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.320240 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.320453 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.320541 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.320792 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.320894 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.321126 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.321243 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.321435 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.321560 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.321676 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.321883 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.321993 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.322212 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.322310 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.322523 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.322613 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.322832 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.322930 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.323141 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.323232 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.323446 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.323590 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.323745 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.323833 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.324051 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.324161 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.324352 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.324446 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.324653 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.324753 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.324953 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.325041 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.325255 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.325347 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.325554 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.325644 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.325860 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.325964 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.326194 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.326284 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.326494 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.326590 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.326808 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.326905 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.327115 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.327212 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.327414 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.327503 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.327714 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.327804 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.328014 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.328113 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.328313 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.328409 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.328626 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.328722 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.328925 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.329015 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.329225 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.329315 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.329535 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.329677 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.329835 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.329952 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.330159 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.330255 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.330465 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.330553 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.330764 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.330861 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.331066 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.331154 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.331371 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.331460 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.331669 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.331765 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.331970 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.332067 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.332276 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.332372 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.332576 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.332672 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.332876 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.332964 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.333174 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.333261 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.333472 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.333570 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.333771 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.333885 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.334102 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.334205 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.334401 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.334511 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.334700 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.334793 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.334991 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.335082 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.335303 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.335408 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.335616 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.335716 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.335924 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.336029 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.336224 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.336342 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.336550 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.336720 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.336865 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:17:57.337167 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.337265 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.337507 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.337598 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.337844 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.337983 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.338180 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.338271 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.338508 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.338597 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.338837 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.338973 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.339151 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.339241 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.339461 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.339548 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.339773 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.339870 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.340097 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.340187 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.340402 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.340491 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.340708 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.340806 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.341016 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.341105 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.341330 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.341429 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.341648 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.341830 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.341999 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.342099 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.342314 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.342412 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.342630 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.342720 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.342945 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.343033 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.343254 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.343351 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.343568 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.343671 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.343894 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.343991 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.344216 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.344324 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.344526 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.344634 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.344860 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.344964 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.345199 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.345297 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.345511 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.345615 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.345830 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.345945 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.346171 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.346268 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.346482 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.346593 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.346788 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.346884 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.347094 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.347198 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.347415 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.347512 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.347740 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.347843 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.348048 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.348156 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.348361 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.348459 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.348671 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.348772 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.348979 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.349075 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.349292 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.349388 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.349603 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.349696 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.349928 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.350040 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.350263 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.350356 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.350574 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.350667 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.350886 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.350988 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.351192 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.351293 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.351504 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.351596 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.351814 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.351922 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.352636 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.352769 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.352946 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.353144 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.353236 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.353461 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.353562 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.353773 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.353922 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.354115 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.354242 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.354434 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.356944 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.357072 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.357183 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.357291 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.357410 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.357410 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.357612 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.357612 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.357830 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.357998 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.358111 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.358218 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.358324 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.358430 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.358549 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.358666 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.358775 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.358882 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.358989 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.359111 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.359203 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.359299 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.359420 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.359516 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.359600 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.359689 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.359771 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.359861 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.359950 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.360070 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.360166 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.360250 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.360339 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.360339 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.360494 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.360597 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.360678 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.360757 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.360845 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.360934 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.361016 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.361097 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.361177 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.361257 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.361346 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.361435 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.361518 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.361642 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.361734 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.361979 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.362086 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.362289 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.362378 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.362599 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.362686 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.362931 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.363022 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.363233 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.363321 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.363554 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.363649 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.363873 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.363962 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.364187 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.364277 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.364492 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.364614 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.364794 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.364894 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.365092 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.365199 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.365392 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.365489 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.365692 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.365794 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.366017 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.366107 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.366318 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.366458 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.366618 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.366707 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.366920 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.367009 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.367218 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.367320 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.367519 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.367616 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.368479 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.368599 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.368806 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.368910 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.369118 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.369256 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.369426 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.369559 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.369727 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.369826 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.370058 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.370194 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.370383 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.370474 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.370698 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.370788 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.371036 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.371123 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.371350 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.371439 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.371671 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.371762 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.371980 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.372071 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.372289 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.372386 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.372601 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.372690 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.372908 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.373004 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.373212 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.373301 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.373517 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.373608 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.373826 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.373947 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.374168 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.374265 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.374477 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.374593 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.374782 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.374881 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.375094 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.375192 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.375396 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.375484 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.375709 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.375799 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.376011 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.376109 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.376316 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.376413 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.376630 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.376727 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.376961 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.377057 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.377272 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.377369 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.377588 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.377676 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.377910 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.378021 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.378226 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.378316 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.378531 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.378629 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.378835 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.378926 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.379141 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.379239 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.379446 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.379538 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.379760 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.379852 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.380064 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.380161 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.380377 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.380483 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.380682 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.380773 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.380992 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.381080 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.381294 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.381390 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.381606 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.381697 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.381924 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.382017 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.382238 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.382329 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.382561 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.382651 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.382884 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.382972 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.383192 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.383353 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.383526 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.383617 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.383841 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.383992 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.384146 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.384318 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.384451 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.384632 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.384755 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.384948 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.385073 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.385262 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.385372 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.385571 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.385674 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.385915 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.386022 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.386212 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.386302 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.386526 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.386624 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.386826 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.386924 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.387136 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.387225 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.387437 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.387533 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.387736 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.387840 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.388033 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.388123 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.388337 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.388427 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.388641 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.388739 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.388944 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.389032 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.389257 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.389346 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.389564 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.389667 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.389861 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.389972 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.390181 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.390272 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.390495 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.390595 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.390797 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.390885 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.391093 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.391188 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.391391 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.391482 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.391688 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.391784 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.391990 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.392092 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.392294 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.392385 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.392603 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.392700 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.392916 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.393018 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.393220 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.393309 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.393523 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.393619 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.393832 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.393970 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.394161 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.394251 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.394466 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.394558 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.394775 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.394945 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.395092 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.395180 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.395374 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.395463 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.395680 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.395784 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.395987 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.396076 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.396292 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.396381 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.396595 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.396699 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.396903 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.396992 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.397208 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.397296 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.397513 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.397603 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.397817 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.397950 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.398142 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.398232 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.398448 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.398538 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.398752 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.399342 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.399696 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.399934 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.400109 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.400271 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.400590 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.400678 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.400916 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.401007 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.401238 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.401394 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.401556 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.401649 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.401906 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.402033 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.402231 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.402324 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.402564 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.402653 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.402873 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.402972 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.403182 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.403273 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.403487 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.403586 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.403789 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.403879 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.404093 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.404182 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.404394 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.404490 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.404696 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.404786 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.404996 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.405094 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.405299 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.405400 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.405597 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.405685 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.405920 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.406026 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.406225 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.406315 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.406525 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.406613 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.406825 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.406923 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.407124 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.407221 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.407431 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.407520 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.407731 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.407833 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.408039 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.408129 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.408341 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.408437 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.408639 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.408731 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.408938 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.409027 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.409236 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.409325 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.409535 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.409662 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.409839 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.410007 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.410200 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.410300 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.410502 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.410635 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.410838 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.410929 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.411136 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.411225 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.411437 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.411527 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.411753 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.411856 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.412053 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.412152 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.412350 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.412448 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.412650 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.412740 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.412957 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.413056 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.413259 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.413347 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.413553 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.413640 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.413857 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.413983 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.414179 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.414269 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.414500 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.414857 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.415175 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.415317 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.415488 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.415613 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.415797 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.415923 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.416106 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.416226 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.416417 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.416536 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.416722 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.416842 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.417034 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.417124 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.417342 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.417432 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.417645 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.417735 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.417970 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.418078 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.418281 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.418379 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.418588 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.418679 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.418891 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.418983 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.419200 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.419289 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.419497 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.419662 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.419796 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.419887 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.420086 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.420175 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.420391 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.420489 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.420692 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.420781 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.420991 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.421079 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.421298 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.421394 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.421601 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.421689 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.421927 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.422032 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.422231 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.422334 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.422533 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.422623 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.422837 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.422927 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.423137 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.423228 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.423438 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.423526 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.423740 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.423894 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.424050 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.424216 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.424371 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.424518 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.424686 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.424825 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.424989 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.425126 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.425297 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.425432 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.425600 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.425698 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.425929 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.426036 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.426236 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.426326 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.426544 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.426643 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.426846 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.426945 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.427148 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.427239 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.427450 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.427550 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.427753 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.427843 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.428055 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.428143 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.428356 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.428459 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.428657 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.428746 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.428955 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.429044 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.429256 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.429355 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.429560 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.429657 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.429919 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.430011 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.430776 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.430879 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.431120 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.431386 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.431476 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.431710 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.431813 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.432019 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.432110 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.432328 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.432418 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.432635 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.432734 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.432934 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.433047 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.433240 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.433344 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.433548 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.433645 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.433854 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.433959 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.434178 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.434266 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.434479 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.434570 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.434780 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.434869 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.435089 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.435177 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.435395 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.435532 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.435701 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.435789 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.436017 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.436104 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.436335 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.436426 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.436635 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.436732 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.436938 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.437028 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.437243 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.437334 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.437546 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.437636 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.437850 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.438001 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.438180 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.438269 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.438484 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.438574 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.438790 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.438888 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.439097 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.439186 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.439402 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.439490 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.439710 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.439810 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.440012 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.440102 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.440317 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.440405 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.440619 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.440722 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.440922 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.441022 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.441221 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.441310 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.441530 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.441620 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.441832 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.441943 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.442158 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.442259 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.442456 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.442545 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.442758 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.442855 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.443055 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.443143 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.443358 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.443486 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.443787 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.443884 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.444092 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.444188 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.444394 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.444492 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.444697 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.444785 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.445000 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.445097 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.445308 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.445415 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.445615 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.445733 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.445995 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.446183 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.446307 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.446608 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.446727 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.446918 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.447039 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.447228 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.447351 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.447537 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.447662 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.447838 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.447967 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.448142 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.448272 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.448448 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.448581 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.448767 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.448903 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.449069 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.449211 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.449355 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.449516 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.449653 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.449820 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.450002 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.450166 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.450325 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.450473 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.450612 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.450794 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.451018 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.451208 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.451326 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.451518 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.451628 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.451824 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.452038 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.452238 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.452349 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.452550 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.452650 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.452860 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.452951 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.453180 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.453269 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.453501 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.453599 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.453823 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.453956 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.454151 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.454257 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.454465 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.454555 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.454776 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.454879 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.455092 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.455181 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.455399 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.455489 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.455710 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.455811 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.456008 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.456099 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.456322 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.456411 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.456642 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.456741 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.456963 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.457054 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.457275 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.457366 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.457594 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.457694 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.458038 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.458144 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.458345 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.458435 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.458665 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.458755 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.458984 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.459082 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.459285 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.459373 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.459588 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.459681 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.459895 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.459984 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.460193 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.460283 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.460495 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.460594 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.460798 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.460887 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.461106 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.461229 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.461947 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.462046 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.462256 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.462351 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.462562 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.462671 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.462864 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.462972 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.463161 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.463253 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.463477 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.463577 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.463779 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.463871 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.464094 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.464192 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.464402 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.464504 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.464720 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.464811 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.465035 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.465124 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.465335 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.465433 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.465647 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.465736 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.465974 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.466098 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.466294 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.466556 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.466651 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.466860 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.466951 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.467162 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.467266 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.467501 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.467591 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.467804 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.467893 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.468120 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.468218 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.468446 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.468535 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.468768 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.468857 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.469076 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.469176 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.469402 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.469491 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.469721 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.469813 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.470061 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.470162 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.470375 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.470466 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.470694 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.470791 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.470997 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.471087 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.471298 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.471404 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.471601 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.471692 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.471898 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.471995 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.472199 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.472290 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.472499 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.472606 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.472805 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.472894 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.473102 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.473190 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.473401 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.473505 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.473702 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.473791 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.474041 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.474134 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.474345 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.474461 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.474663 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.474754 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.474968 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.475057 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.475265 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.475369 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.475566 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.475655 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.475862 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.475957 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.476197 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.476300 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.476497 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.476587 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.476825 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.476917 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.477212 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.477332 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.477528 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.477726 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.477850 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.478090 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.478194 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.478405 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.478496 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.478734 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.478833 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.479054 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.479152 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.479372 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.479462 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.479683 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.479772 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.479994 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.480089 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.480302 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.480441 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.480612 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.480703 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.480916 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.481014 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.481224 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.481326 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.481531 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.481631 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.481838 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.481947 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.482179 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.482376 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.482701 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.482794 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.483010 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.483108 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.483320 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.483411 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.483636 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.483734 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.483945 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.484033 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.484254 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.484352 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.484560 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.484659 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.484866 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.484956 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.485173 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.485264 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.485479 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.485578 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.485789 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.485912 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.486139 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.486228 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.486461 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.486552 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.486789 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.486877 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.487100 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.487190 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.487412 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.487503 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.487721 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.487810 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.488029 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.488118 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.488339 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.488429 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.488673 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.488764 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.488976 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.489140 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.489285 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.489375 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.489595 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.489691 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.489923 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.490027 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.490232 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.490323 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.490538 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.490628 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.490847 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.490937 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.491153 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.491241 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.491460 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.491571 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.491769 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.491870 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.492075 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.492167 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.492382 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.492478 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.493367 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.493477 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.493701 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.493792 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.494056 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.494164 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.494373 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.494480 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.494732 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.494821 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.495052 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.495151 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.495370 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.495565 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.495881 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.495969 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.496200 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.496301 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.496519 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.496615 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.496840 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.496930 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.497152 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.497250 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.497467 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.497556 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.497786 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.497896 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.498125 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.498223 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.498428 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.498519 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.498733 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.498822 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.499036 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.499134 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.499336 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.499425 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.499641 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.499729 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.499948 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.500045 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.500247 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.500337 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.500560 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.500658 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.500863 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.500953 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.501178 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.501389 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.501708 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.501821 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.502060 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.502160 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.502381 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.502471 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.502700 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.502810 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.503015 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.503106 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.503319 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.503409 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.503630 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.503738 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.503932 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.504060 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.504239 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.504328 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.504546 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.504636 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.504847 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.504936 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.505147 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.505236 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.505446 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.505546 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.505750 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.505840 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.506088 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.506216 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.506394 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.506484 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.506698 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.506786 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.506995 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.507083 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.507305 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.507395 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.507603 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.507692 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.507904 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.508003 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.508217 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.508330 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.509051 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.509140 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.509350 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.509449 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.509658 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.509814 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.510005 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.510135 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.510264 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.510426 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.510586 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.510776 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.510921 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.511059 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.511189 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.511332 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.511465 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.511604 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.511735 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.511865 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.512016 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.512208 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.512335 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.512469 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.512641 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.512774 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.512960 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.513091 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.513262 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.513391 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.513561 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.513702 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.513900 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.514088 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.514217 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.514357 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.514519 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.514650 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.514828 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.514959 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.515133 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.515266 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.515468 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.515606 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.515775 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.515958 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.516118 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.516307 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.516639 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.516787 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.516956 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.517087 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.517282 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.517421 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.517608 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.517748 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.517941 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.518070 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.518249 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.518396 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.518539 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.518674 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.518856 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.518984 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.519161 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.519289 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.519525 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.519653 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.519778 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.519903 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.520053 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.520184 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.520360 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.520493 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.520667 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.520846 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.520979 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.521105 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.521266 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.521398 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.521571 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.521711 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.521937 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.522100 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.522230 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.522354 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.522481 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.522605 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.522792 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.522937 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.523102 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.523234 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.523414 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.523554 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.523736 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.523903 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.524079 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.524215 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.524432 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.524563 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.524790 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.524934 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.525102 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.525213 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.525413 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.525543 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.525721 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.525852 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.526066 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.526195 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.526356 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.526485 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.526671 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.526805 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.526979 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.527108 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.527284 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.527426 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.527601 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.527729 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.527995 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.528125 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.528311 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.528454 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.528629 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.528768 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.528935 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.529063 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.529246 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.529392 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.529564 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.529691 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.529894 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.530047 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.530186 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.530310 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.530508 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.530637 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.530817 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.531015 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.531163 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.531287 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.531461 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.531599 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.531782 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.531911 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.532085 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.532216 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.532385 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.532530 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.532684 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.532818 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.532989 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.533119 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.533300 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.533430 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.533602 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.533739 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.533930 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.534065 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.534231 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.534420 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.534545 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.534680 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.534825 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.534949 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.535109 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.535240 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.535409 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.535549 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.535705 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.535834 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.536008 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.536149 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.536284 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.536425 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.536608 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.536747 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.536874 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.537001 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.537163 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.537304 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.537465 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.537597 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.537763 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.537923 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.538084 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.538229 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.538395 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.538537 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.538678 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.538814 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.538988 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.539119 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.539290 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.539419 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.539889 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.540031 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.540194 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.540327 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.540528 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.540660 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.540859 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.541009 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.541173 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.541314 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.541496 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.541637 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.541943 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.542109 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.542238 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.542371 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.542503 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.542627 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.542748 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.542880 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.543065 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.543157 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.543378 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.543470 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.543688 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.543789 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.544004 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.544093 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.544312 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.544445 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.544619 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.544710 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.544931 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.545038 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.545229 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.545324 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.545535 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.545626 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.545844 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.546005 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.546188 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.546278 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.546493 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.546621 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.546802 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.546924 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.547117 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.547262 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.547433 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.547561 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.547745 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.547872 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.548050 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.548275 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.548410 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.548531 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.548652 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.548776 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.548962 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.549100 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.549268 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.549402 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.549573 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.549699 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.549936 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.550080 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.550213 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.550333 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.550520 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.550647 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.550833 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.550959 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.551155 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.551282 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.551464 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.551601 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.551778 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.551910 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.552097 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.552223 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.552422 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.552545 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.552739 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.552867 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.553068 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.553209 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.553393 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.553541 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.553720 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.553838 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.554050 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.554141 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.554353 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.554455 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.554657 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:17:57.554754 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 12:17:57.554901 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 12:17:57.616272 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: INFO dbcounter [None req-aba1a89b-a32f-4c82-91d8-ec2252a117e7 None None] Registered counter for database nova_api Jun 16 12:17:57.616444 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: INFO dbcounter [None req-cde765f8-8d7c-42e6-9e25-7a95dde06915 None None] Registered counter for database nova_api Jun 16 12:17:57.637710 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG oslo_db.sqlalchemy.engines [None req-aba1a89b-a32f-4c82-91d8-ec2252a117e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103040) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 12:17:57.639320 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG oslo_db.sqlalchemy.engines [None req-cde765f8-8d7c-42e6-9e25-7a95dde06915 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103041) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 12:17:57.644398 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG dbcounter [-] [103040] Writer thread running {{(pid=103040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 12:17:57.645809 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG dbcounter [-] [103041] Writer thread running {{(pid=103041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 12:17:57.702877 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.context [None req-aba1a89b-a32f-4c82-91d8-ec2252a117e7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),775f0c5f-83ba-4167-a2ea-1fd3bdd524cf(cell1) {{(pid=103040) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 12:17:57.703641 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.context [None req-cde765f8-8d7c-42e6-9e25-7a95dde06915 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),775f0c5f-83ba-4167-a2ea-1fd3bdd524cf(cell1) {{(pid=103041) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 12:17:57.707018 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG oslo_concurrency.lockutils [None req-aba1a89b-a32f-4c82-91d8-ec2252a117e7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:17:57.707700 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG oslo_concurrency.lockutils [None req-cde765f8-8d7c-42e6-9e25-7a95dde06915 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:17:57.708615 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG oslo_concurrency.lockutils [None req-aba1a89b-a32f-4c82-91d8-ec2252a117e7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:17:57.709272 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG oslo_concurrency.lockutils [None req-cde765f8-8d7c-42e6-9e25-7a95dde06915 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:17:57.709401 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG oslo_concurrency.lockutils [None req-aba1a89b-a32f-4c82-91d8-ec2252a117e7 None None] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:17:57.710113 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG oslo_concurrency.lockutils [None req-cde765f8-8d7c-42e6-9e25-7a95dde06915 None None] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:17:57.711432 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG oslo_concurrency.lockutils [None req-aba1a89b-a32f-4c82-91d8-ec2252a117e7 None None] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:17:57.712364 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG oslo_concurrency.lockutils [None req-cde765f8-8d7c-42e6-9e25-7a95dde06915 None None] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:17:57.713442 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: INFO dbcounter [None req-aba1a89b-a32f-4c82-91d8-ec2252a117e7 None None] Registered counter for database nova_cell0 Jun 16 12:17:57.714365 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: INFO dbcounter [None req-cde765f8-8d7c-42e6-9e25-7a95dde06915 None None] Registered counter for database nova_cell0 Jun 16 12:17:57.717329 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: INFO dbcounter [None req-aba1a89b-a32f-4c82-91d8-ec2252a117e7 None None] Registered counter for database nova_cell1 Jun 16 12:17:57.718150 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: INFO dbcounter [None req-cde765f8-8d7c-42e6-9e25-7a95dde06915 None None] Registered counter for database nova_cell1 Jun 16 12:17:57.724784 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG oslo_db.sqlalchemy.engines [None req-aba1a89b-a32f-4c82-91d8-ec2252a117e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103040) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 12:17:57.727440 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG oslo_db.sqlalchemy.engines [None req-aba1a89b-a32f-4c82-91d8-ec2252a117e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103040) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 12:17:57.730436 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG oslo_db.sqlalchemy.engines [None req-cde765f8-8d7c-42e6-9e25-7a95dde06915 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103041) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 12:17:57.731689 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG dbcounter [-] [103040] Writer thread running {{(pid=103040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 12:17:57.732149 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG oslo_db.sqlalchemy.engines [None req-cde765f8-8d7c-42e6-9e25-7a95dde06915 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103041) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 12:17:57.738334 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG dbcounter [-] [103041] Writer thread running {{(pid=103041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 12:17:57.740348 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG dbcounter [-] [103041] Writer thread running {{(pid=103041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 12:17:57.874189 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG dbcounter [-] [103040] Writer thread running {{(pid=103040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 12:17:57.884161 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: INFO dbcounter [None req-aba1a89b-a32f-4c82-91d8-ec2252a117e7 None None] Registered counter for database nova_cell0 Jun 16 12:17:57.889408 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: INFO dbcounter [None req-cde765f8-8d7c-42e6-9e25-7a95dde06915 None None] Registered counter for database nova_cell0 Jun 16 12:17:57.893117 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG oslo_db.sqlalchemy.engines [None req-aba1a89b-a32f-4c82-91d8-ec2252a117e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103040) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 12:17:57.896225 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG oslo_db.sqlalchemy.engines [None req-cde765f8-8d7c-42e6-9e25-7a95dde06915 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103041) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 12:17:57.897387 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG dbcounter [-] [103040] Writer thread running {{(pid=103040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 12:17:57.902573 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG dbcounter [-] [103041] Writer thread running {{(pid=103041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 12:17:58.237693 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: WARNING keystonemiddleware.auth_token [None req-cde765f8-8d7c-42e6-9e25-7a95dde06915 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 12:17:58.237929 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: WARNING keystonemiddleware.auth_token [None req-aba1a89b-a32f-4c82-91d8-ec2252a117e7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 12:17:58.245032 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: WARNING keystonemiddleware.auth_token [None req-aba1a89b-a32f-4c82-91d8-ec2252a117e7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 12:17:58.245143 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: WARNING keystonemiddleware.auth_token [None req-cde765f8-8d7c-42e6-9e25-7a95dde06915 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 12:17:58.586236 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: WARNING keystonemiddleware.auth_token [None req-cde765f8-8d7c-42e6-9e25-7a95dde06915 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 12:17:58.588699 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: WARNING keystonemiddleware.auth_token [None req-aba1a89b-a32f-4c82-91d8-ec2252a117e7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 12:17:58.592677 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: WARNING keystonemiddleware.auth_token [None req-cde765f8-8d7c-42e6-9e25-7a95dde06915 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 12:17:58.594680 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: WARNING keystonemiddleware.auth_token [None req-aba1a89b-a32f-4c82-91d8-ec2252a117e7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 12:17:58.597972 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556c7af4c9c0 pid: 103041 (default app) Jun 16 12:17:58.599945 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556c7af4c9c0 pid: 103040 (default app) Jun 16 12:17:58.600039 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi [None req-cde765f8-8d7c-42e6-9e25-7a95dde06915 None None] Calling method '>' {{(pid=103041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:17:58.601219 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: INFO nova.api.openstack.requestlog [None req-cde765f8-8d7c-42e6-9e25-7a95dde06915 None None] 10.222.0.45 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001726 Jun 16 12:17:58.601628 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: [pid: 103041|app: 0|req: 1/1] 10.222.0.45 () {50 vars in 788 bytes} [Thu Jun 16 12:17:58 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:19:15.133788 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi [None req-aba1a89b-a32f-4c82-91d8-ec2252a117e7 None None] Calling method '>' {{(pid=103040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:19:15.135155 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: INFO nova.api.openstack.requestlog [None req-aba1a89b-a32f-4c82-91d8-ec2252a117e7 None None] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002048 Jun 16 12:19:15.135866 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: [pid: 103040|app: 0|req: 1/2] 10.222.0.45 () {54 vars in 930 bytes} [Thu Jun 16 12:19:15 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:19:15.148065 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG dbcounter [-] [103041] Writing DB stats nova_api:SELECT=3 {{(pid=103041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:19:15.149180 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG dbcounter [-] [103041] Writing DB stats nova_cell1:SELECT=3 {{(pid=103041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:19:15.149943 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG dbcounter [-] [103041] Writing DB stats nova_cell0:SELECT=3 {{(pid=103041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:19:15.151163 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG dbcounter [-] [103041] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:19:15.579942 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi [None req-8a8a4354-3ab1-4a66-9132-d1cd55e42836 admin admin] Calling method '>' {{(pid=103041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:19:15.610281 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: INFO nova.api.openstack.requestlog [None req-8a8a4354-3ab1-4a66-9132-d1cd55e42836 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.468345 Jun 16 12:19:15.611006 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: [pid: 103041|app: 0|req: 2/3] 10.222.0.45 () {60 vars in 1291 bytes} [Thu Jun 16 12:19:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:19:17.800718 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi [None req-aba1a89b-a32f-4c82-91d8-ec2252a117e7 None None] Calling method '>' {{(pid=103040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:19:17.802562 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: INFO nova.api.openstack.requestlog [None req-aba1a89b-a32f-4c82-91d8-ec2252a117e7 None None] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002293 Jun 16 12:19:17.802958 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: [pid: 103040|app: 0|req: 2/4] 10.222.0.45 () {54 vars in 930 bytes} [Thu Jun 16 12:19:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:19:17.865839 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi [None req-8a2c66a3-4560-41bb-84b8-12151119842c admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "os-flavor-access:is_public": true, "name": "cirros256", "vcpus": 1, "rxtx_factor": 1.0, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 1}} {{(pid=103041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:19:17.884245 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 12:19:17.884245 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: warnings.warn(msg) Jun 16 12:19:17.914376 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: INFO nova.api.openstack.requestlog [None req-8a2c66a3-4560-41bb-84b8-12151119842c admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.105172 Jun 16 12:19:17.914937 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: [pid: 103041|app: 0|req: 3/5] 10.222.0.45 () {64 vars in 1282 bytes} [Thu Jun 16 12:19:17 2022] POST /compute/v2.1/flavors => generated 407 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 12:19:17.928437 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG dbcounter [-] [103040] Writing DB stats nova_api:SELECT=3 {{(pid=103040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:19:17.929287 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG dbcounter [-] [103040] Writing DB stats nova_cell1:SELECT=3 {{(pid=103040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:19:17.930338 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG dbcounter [-] [103040] Writing DB stats nova_cell0:SELECT=3 {{(pid=103040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:19:17.931568 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG dbcounter [-] [103040] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:19:18.138086 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi [None req-cf7cbdbf-335f-4b6b-806a-8c5b79041948 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:19:18.140626 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 12:19:18.140626 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: warnings.warn(msg) Jun 16 12:19:18.204058 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: INFO nova.api.openstack.requestlog [None req-cf7cbdbf-335f-4b6b-806a-8c5b79041948 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.280700 Jun 16 12:19:18.204874 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: [pid: 103040|app: 0|req: 3/6] 10.222.0.45 () {64 vars in 1335 bytes} [Thu Jun 16 12:19:17 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:19:20.387266 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi [None req-8a2c66a3-4560-41bb-84b8-12151119842c admin admin] Calling method '>' {{(pid=103041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:19:20.389014 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: INFO nova.api.openstack.requestlog [None req-8a2c66a3-4560-41bb-84b8-12151119842c admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002194 Jun 16 12:19:20.389420 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: [pid: 103041|app: 0|req: 4/7] 10.222.0.45 () {54 vars in 930 bytes} [Thu Jun 16 12:19:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:19:20.528343 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi [None req-0382af40-f7cb-435a-a0c7-24ed01f18602 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "os-flavor-access:is_public": true, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 512, "rxtx_factor": 1.0, "disk": 5, "vcpus": 1}} {{(pid=103040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:19:20.548783 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 12:19:20.548783 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: warnings.warn(msg) Jun 16 12:19:20.569020 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: INFO nova.api.openstack.requestlog [None req-0382af40-f7cb-435a-a0c7-24ed01f18602 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.172833 Jun 16 12:19:20.569575 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: [pid: 103040|app: 0|req: 4/8] 10.222.0.45 () {64 vars in 1282 bytes} [Thu Jun 16 12:19:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 12:19:20.581484 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi [None req-9616196f-8728-4420-ac95-baa811c4828f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:19:20.584242 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 12:19:20.584242 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: warnings.warn(msg) Jun 16 12:19:20.617723 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: INFO nova.api.openstack.requestlog [None req-9616196f-8728-4420-ac95-baa811c4828f admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039834 Jun 16 12:19:20.618423 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: [pid: 103041|app: 0|req: 5/9] 10.222.0.45 () {64 vars in 1335 bytes} [Thu Jun 16 12:19:20 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:19:22.847416 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi [None req-0382af40-f7cb-435a-a0c7-24ed01f18602 admin admin] Calling method '>' {{(pid=103040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:19:22.848459 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: INFO nova.api.openstack.requestlog [None req-0382af40-f7cb-435a-a0c7-24ed01f18602 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Jun 16 12:19:22.849013 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: [pid: 103040|app: 0|req: 5/10] 10.222.0.45 () {54 vars in 930 bytes} [Thu Jun 16 12:19:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:19:22.914861 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi [None req-ac5a5671-9e38-431b-af86-a47a54fd1b59 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 10, "id": "d2", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "ram": 1024}} {{(pid=103041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:19:22.934884 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: INFO nova.api.openstack.requestlog [None req-ac5a5671-9e38-431b-af86-a47a54fd1b59 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.079917 Jun 16 12:19:22.935431 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: [pid: 103041|app: 0|req: 6/11] 10.222.0.45 () {64 vars in 1282 bytes} [Thu Jun 16 12:19:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 12:19:22.948143 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi [None req-83715472-c74a-4726-8202-3064e9a9813e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:19:22.973082 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: INFO nova.api.openstack.requestlog [None req-83715472-c74a-4726-8202-3064e9a9813e admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028454 Jun 16 12:19:22.982086 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: [pid: 103040|app: 0|req: 6/12] 10.222.0.45 () {64 vars in 1335 bytes} [Thu Jun 16 12:19:22 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:19:25.153484 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi [None req-ac5a5671-9e38-431b-af86-a47a54fd1b59 admin admin] Calling method '>' {{(pid=103041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:19:25.154551 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: INFO nova.api.openstack.requestlog [None req-ac5a5671-9e38-431b-af86-a47a54fd1b59 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Jun 16 12:19:25.154953 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: [pid: 103041|app: 0|req: 7/13] 10.222.0.45 () {54 vars in 930 bytes} [Thu Jun 16 12:19:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:19:25.213721 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi [None req-78b2e7c2-eae9-49b5-bd14-01e1f12fe0fa admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d3", "vcpus": 2}} {{(pid=103040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:19:25.231431 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: INFO nova.api.openstack.requestlog [None req-78b2e7c2-eae9-49b5-bd14-01e1f12fe0fa admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.070132 Jun 16 12:19:25.232597 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: [pid: 103040|app: 0|req: 7/14] 10.222.0.45 () {64 vars in 1282 bytes} [Thu Jun 16 12:19:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 12:19:25.244285 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi [None req-a2d03ef0-d496-4eab-a806-9d41e8e30c75 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:19:25.266254 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: INFO nova.api.openstack.requestlog [None req-a2d03ef0-d496-4eab-a806-9d41e8e30c75 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025671 Jun 16 12:19:25.266925 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: [pid: 103041|app: 0|req: 8/15] 10.222.0.45 () {64 vars in 1335 bytes} [Thu Jun 16 12:19:25 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:19:27.453527 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi [None req-78b2e7c2-eae9-49b5-bd14-01e1f12fe0fa admin admin] Calling method '>' {{(pid=103040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:19:27.455234 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: INFO nova.api.openstack.requestlog [None req-78b2e7c2-eae9-49b5-bd14-01e1f12fe0fa admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002217 Jun 16 12:19:27.455820 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: [pid: 103040|app: 0|req: 8/16] 10.222.0.45 () {54 vars in 930 bytes} [Thu Jun 16 12:19:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:19:27.527813 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi [None req-ff703e88-5700-44e8-a292-3e09c2cc25e8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "disk": 20, "swap": 0, "ram": 4096, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4}} {{(pid=103041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:19:27.552262 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: INFO nova.api.openstack.requestlog [None req-ff703e88-5700-44e8-a292-3e09c2cc25e8 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.089466 Jun 16 12:19:27.552972 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: [pid: 103041|app: 0|req: 9/17] 10.222.0.45 () {64 vars in 1282 bytes} [Thu Jun 16 12:19:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 12:19:27.564894 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi [None req-3a16cc86-764a-4d37-a6e6-af5135a4e808 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:19:27.588676 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: INFO nova.api.openstack.requestlog [None req-3a16cc86-764a-4d37-a6e6-af5135a4e808 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027605 Jun 16 12:19:27.589149 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: [pid: 103040|app: 0|req: 9/18] 10.222.0.45 () {64 vars in 1335 bytes} [Thu Jun 16 12:19:27 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:19:29.770156 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi [None req-ff703e88-5700-44e8-a292-3e09c2cc25e8 admin admin] Calling method '>' {{(pid=103041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:19:29.771113 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: INFO nova.api.openstack.requestlog [None req-ff703e88-5700-44e8-a292-3e09c2cc25e8 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002096 Jun 16 12:19:29.771515 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: [pid: 103041|app: 0|req: 10/19] 10.222.0.45 () {54 vars in 930 bytes} [Thu Jun 16 12:19:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:19:29.835580 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi [None req-81d38424-6915-46a0-97c2-38a1faa10c57 admin admin] Calling method '>' {{(pid=103040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:19:29.859782 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: INFO nova.api.openstack.requestlog [None req-81d38424-6915-46a0-97c2-38a1faa10c57 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.082053 Jun 16 12:19:29.862276 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: [pid: 103040|app: 0|req: 10/20] 10.222.0.45 () {60 vars in 1291 bytes} [Thu Jun 16 12:19:29 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:19:32.059239 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi [None req-ff703e88-5700-44e8-a292-3e09c2cc25e8 admin admin] Calling method '>' {{(pid=103041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:19:32.060566 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: INFO nova.api.openstack.requestlog [None req-ff703e88-5700-44e8-a292-3e09c2cc25e8 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001938 Jun 16 12:19:32.061041 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: [pid: 103041|app: 0|req: 11/21] 10.222.0.45 () {54 vars in 930 bytes} [Thu Jun 16 12:19:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:19:32.122838 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi [None req-0f9fa555-1fdb-480f-b06c-0d8f0cecf294 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "name": "m1.tiny", "swap": 0, "id": "1", "vcpus": 1, "os-flavor-access:is_public": true, "ram": 512, "rxtx_factor": 1.0}} {{(pid=103040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:19:32.142882 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: INFO nova.api.openstack.requestlog [None req-0f9fa555-1fdb-480f-b06c-0d8f0cecf294 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.075364 Jun 16 12:19:32.143448 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: [pid: 103040|app: 0|req: 11/22] 10.222.0.45 () {64 vars in 1282 bytes} [Thu Jun 16 12:19:32 2022] POST /compute/v2.1/flavors => generated 402 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 12:19:32.155327 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi [None req-2fb9679c-9843-446f-a977-f8394ff5c5c6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:19:32.179455 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: INFO nova.api.openstack.requestlog [None req-2fb9679c-9843-446f-a977-f8394ff5c5c6 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027750 Jun 16 12:19:32.180048 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: [pid: 103041|app: 0|req: 12/23] 10.222.0.45 () {64 vars in 1332 bytes} [Thu Jun 16 12:19:32 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:19:34.351050 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi [None req-0f9fa555-1fdb-480f-b06c-0d8f0cecf294 admin admin] Calling method '>' {{(pid=103040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:19:34.352713 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: INFO nova.api.openstack.requestlog [None req-0f9fa555-1fdb-480f-b06c-0d8f0cecf294 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002091 Jun 16 12:19:34.353122 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: [pid: 103040|app: 0|req: 12/24] 10.222.0.45 () {54 vars in 930 bytes} [Thu Jun 16 12:19:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:19:34.414814 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi [None req-c38035f8-0fe3-4942-89e8-1df2208b62f2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "disk": 20, "id": "2", "rxtx_factor": 1.0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:19:34.434218 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: INFO nova.api.openstack.requestlog [None req-c38035f8-0fe3-4942-89e8-1df2208b62f2 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.074850 Jun 16 12:19:34.434877 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: [pid: 103041|app: 0|req: 13/25] 10.222.0.45 () {64 vars in 1282 bytes} [Thu Jun 16 12:19:34 2022] POST /compute/v2.1/flavors => generated 405 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 12:19:34.447533 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi [None req-5ec1873f-024e-4ef2-91fb-9fb9a96aef0f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:19:34.471617 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: INFO nova.api.openstack.requestlog [None req-5ec1873f-024e-4ef2-91fb-9fb9a96aef0f admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027665 Jun 16 12:19:34.472515 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: [pid: 103040|app: 0|req: 13/26] 10.222.0.45 () {64 vars in 1332 bytes} [Thu Jun 16 12:19:34 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:19:36.700916 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi [None req-c38035f8-0fe3-4942-89e8-1df2208b62f2 admin admin] Calling method '>' {{(pid=103041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:19:36.702012 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: INFO nova.api.openstack.requestlog [None req-c38035f8-0fe3-4942-89e8-1df2208b62f2 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001550 Jun 16 12:19:36.702422 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: [pid: 103041|app: 0|req: 14/27] 10.222.0.45 () {54 vars in 930 bytes} [Thu Jun 16 12:19:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:19:36.775635 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi [None req-514c54da-cac2-435c-9898-de564ceb2755 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 2, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "3", "disk": 40, "name": "m1.medium", "ram": 4096}} {{(pid=103040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:19:36.795307 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: INFO nova.api.openstack.requestlog [None req-514c54da-cac2-435c-9898-de564ceb2755 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.086136 Jun 16 12:19:36.795874 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: [pid: 103040|app: 0|req: 14/28] 10.222.0.45 () {64 vars in 1282 bytes} [Thu Jun 16 12:19:36 2022] POST /compute/v2.1/flavors => generated 406 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 12:19:36.809072 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi [None req-ecc2a45d-0490-4f06-be92-ae2917525c3c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:19:36.834314 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: INFO nova.api.openstack.requestlog [None req-ecc2a45d-0490-4f06-be92-ae2917525c3c admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028848 Jun 16 12:19:36.838796 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: [pid: 103041|app: 0|req: 15/29] 10.222.0.45 () {64 vars in 1332 bytes} [Thu Jun 16 12:19:36 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:19:39.049758 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi [None req-514c54da-cac2-435c-9898-de564ceb2755 admin admin] Calling method '>' {{(pid=103040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:19:39.050938 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: INFO nova.api.openstack.requestlog [None req-514c54da-cac2-435c-9898-de564ceb2755 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001622 Jun 16 12:19:39.051330 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: [pid: 103040|app: 0|req: 15/30] 10.222.0.45 () {54 vars in 930 bytes} [Thu Jun 16 12:19:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:19:39.108965 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi [None req-e20e7e0b-92bc-4594-bc3c-a0dcbfc5bc14 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "swap": 0, "disk": 80, "rxtx_factor": 1.0, "ram": 8192, "os-flavor-access:is_public": true, "id": "4", "vcpus": 4}} {{(pid=103041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:19:39.129157 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: INFO nova.api.openstack.requestlog [None req-e20e7e0b-92bc-4594-bc3c-a0dcbfc5bc14 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.072173 Jun 16 12:19:39.129693 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: [pid: 103041|app: 0|req: 16/31] 10.222.0.45 () {64 vars in 1282 bytes} [Thu Jun 16 12:19:39 2022] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 12:19:39.141859 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi [None req-72a1a083-bdcb-4e2c-96d1-298582f29c6e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:19:39.167049 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: INFO nova.api.openstack.requestlog [None req-72a1a083-bdcb-4e2c-96d1-298582f29c6e admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029065 Jun 16 12:19:39.167644 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: [pid: 103040|app: 0|req: 16/32] 10.222.0.45 () {64 vars in 1332 bytes} [Thu Jun 16 12:19:39 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:19:41.341198 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi [None req-e20e7e0b-92bc-4594-bc3c-a0dcbfc5bc14 admin admin] Calling method '>' {{(pid=103041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:19:41.342472 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: INFO nova.api.openstack.requestlog [None req-e20e7e0b-92bc-4594-bc3c-a0dcbfc5bc14 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001802 Jun 16 12:19:41.343029 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: [pid: 103041|app: 0|req: 17/33] 10.222.0.45 () {54 vars in 930 bytes} [Thu Jun 16 12:19:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:19:41.412913 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi [None req-bad28602-3bfe-4318-a624-47ec174ab45d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "ram": 16384, "id": "5", "disk": 160, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=103040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:19:41.432136 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: INFO nova.api.openstack.requestlog [None req-bad28602-3bfe-4318-a624-47ec174ab45d admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.082546 Jun 16 12:19:41.432820 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: [pid: 103040|app: 0|req: 17/34] 10.222.0.45 () {64 vars in 1282 bytes} [Thu Jun 16 12:19:41 2022] POST /compute/v2.1/flavors => generated 408 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 12:19:41.445215 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi [None req-b4772cc1-84e3-484e-a51f-c2d7a7825714 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:19:41.470122 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: INFO nova.api.openstack.requestlog [None req-b4772cc1-84e3-484e-a51f-c2d7a7825714 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028773 Jun 16 12:19:41.470982 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: [pid: 103041|app: 0|req: 18/35] 10.222.0.45 () {64 vars in 1332 bytes} [Thu Jun 16 12:19:41 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:20:05.696114 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi [None req-bad28602-3bfe-4318-a624-47ec174ab45d admin admin] Calling method '>' {{(pid=103040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:20:05.697122 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: INFO nova.api.openstack.requestlog [None req-bad28602-3bfe-4318-a624-47ec174ab45d admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Jun 16 12:20:05.697524 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: [pid: 103040|app: 0|req: 18/36] 10.222.0.45 () {54 vars in 930 bytes} [Thu Jun 16 12:20:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:20:05.708965 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG dbcounter [-] [103041] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:20:05.759354 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi [None req-5a1c7086-c5e6-4494-8465-8e66386a82c4 admin admin] Calling method '>' {{(pid=103041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:20:05.776862 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: INFO nova.api.openstack.requestlog [None req-5a1c7086-c5e6-4494-8465-8e66386a82c4 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.073506 Jun 16 12:20:05.777393 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: [pid: 103041|app: 0|req: 19/37] 10.222.0.45 () {60 vars in 1291 bytes} [Thu Jun 16 12:20:05 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 12:20:06.744440 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi [None req-bad28602-3bfe-4318-a624-47ec174ab45d admin admin] Calling method '>' {{(pid=103040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:20:06.745439 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: INFO nova.api.openstack.requestlog [None req-bad28602-3bfe-4318-a624-47ec174ab45d admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 Jun 16 12:20:06.745834 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: [pid: 103040|app: 0|req: 19/38] 10.222.0.45 () {56 vars in 1074 bytes} [Thu Jun 16 12:20:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:20:06.935712 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi [None req-1de47610-f956-4191-a1a5-e6cfbaf1e682 admin admin] Calling method '>' {{(pid=103041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:20:06.942193 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: INFO nova.api.openstack.wsgi [None req-1de47610-f956-4191-a1a5-e6cfbaf1e682 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 16 12:20:06.945499 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi [None req-1de47610-f956-4191-a1a5-e6cfbaf1e682 admin admin] Request method failure captured: Jun 16 12:20:06.945499 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 16 12:20:06.945499 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: Accept: application/json Jun 16 12:20:06.945499 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: Accept-Encoding: gzip, deflate Jun 16 12:20:06.945499 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: Connection: keep-alive Jun 16 12:20:06.945499 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: Content-Length: 0 Jun 16 12:20:06.945499 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: Host: 10.222.0.45 Jun 16 12:20:06.945499 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: Openstack-Api-Version: compute 2.90 Jun 16 12:20:06.945499 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: Openstack-System-Scope: None Jun 16 12:20:06.945499 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: User-Agent: python-novaclient Jun 16 12:20:06.945499 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: X-Auth-Token: gAAAAABiqx_2H2kKumF0--bTNXeg0iYOB61JhlY0UwV7JU_twaWRKCly8TYIlDRUx2D5G4IIJUgwH5pAfmjiWlxVmeWkwMIAYzaJZMbxSjdD6kYI-q_E-CZvhD-CH5OQ6NE0je0MrP1glnRYkHybEDVxQrP523RI-tboCa9JFGTTDqK6xpnSndc Jun 16 12:20:06.945499 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: X-Domain-Id: None Jun 16 12:20:06.945499 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: X-Domain-Name: None Jun 16 12:20:06.945499 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: X-Identity-Status: Confirmed Jun 16 12:20:06.945499 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: X-Is-Admin-Project: True Jun 16 12:20:06.945499 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 12:20:06.945499 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: X-Project-Domain-Id: default Jun 16 12:20:06.945499 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: X-Project-Domain-Name: Default Jun 16 12:20:06.945499 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: X-Project-Id: cee0088a8bed428783d8d62046ef865c Jun 16 12:20:06.945499 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: X-Project-Name: admin Jun 16 12:20:06.945499 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: X-Role: member,reader,admin Jun 16 12:20:06.945499 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: X-Roles: member,reader,admin Jun 16 12:20:06.947198 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/cee0088a8bed428783d8d62046ef865c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cee0088a8bed428783d8d62046ef865c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_cee0088a8bed428783d8d62046ef865c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cee0088a8bed428783d8d62046ef865c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Jun 16 12:20:06.947198 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: X-Tenant: admin Jun 16 12:20:06.947198 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: X-Tenant-Id: cee0088a8bed428783d8d62046ef865c Jun 16 12:20:06.947198 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: X-Tenant-Name: admin Jun 16 12:20:06.947198 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: X-User: admin Jun 16 12:20:06.947198 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: X-User-Domain-Id: default Jun 16 12:20:06.947198 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: X-User-Domain-Name: Default Jun 16 12:20:06.947198 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: X-User-Id: 40a7364cd5094f4a878e274d7942bef8 Jun 16 12:20:06.947198 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: X-User-Name: admin Jun 16 12:20:06.947198 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: method: > Jun 16 12:20:06.947198 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: exception: Flavor 42 could not be found. Jun 16 12:20:06.947198 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: action_args: {'id': '42'} Jun 16 12:20:06.947198 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: {{(pid=103041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:20:06.947198 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:20:06.948256 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 12:20:06.948256 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 12:20:06.948256 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 12:20:06.948256 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 12:20:06.948256 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 12:20:06.948256 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 12:20:06.948256 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 12:20:06.948256 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 12:20:06.948256 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 12:20:06.948256 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:20:06.948256 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 12:20:06.948256 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 12:20:06.948256 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 16 12:20:06.948256 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi Jun 16 12:20:06.948256 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:20:06.948256 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi Jun 16 12:20:06.948256 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:20:06.948256 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:20:06.948256 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:20:06.949611 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:20:06.949611 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:20:06.949611 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:20:06.949611 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:20:06.949611 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 12:20:06.949611 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:20:06.949611 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 16 12:20:06.949611 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi Jun 16 12:20:06.949611 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:20:06.949611 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi Jun 16 12:20:06.949611 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:20:06.949611 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:20:06.949611 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:20:06.949611 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:20:06.949611 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:20:06.949611 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 16 12:20:06.949611 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi Jun 16 12:20:06.949611 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi [None req-1de47610-f956-4191-a1a5-e6cfbaf1e682 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:20:06.951064 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: INFO nova.api.openstack.requestlog [None req-1de47610-f956-4191-a1a5-e6cfbaf1e682 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.063481 Jun 16 12:20:06.951064 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: [pid: 103041|app: 0|req: 20/39] 10.222.0.45 () {60 vars in 1190 bytes} [Thu Jun 16 12:20:06 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 12:20:06.957162 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi [None req-6134f91f-051a-430a-a6d1-b8157931469a admin admin] Calling method '>' {{(pid=103040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:20:06.960350 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG dbcounter [-] [103040] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:20:06.980263 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: INFO nova.api.openstack.requestlog [None req-6134f91f-051a-430a-a6d1-b8157931469a admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027265 Jun 16 12:20:06.980808 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: [pid: 103040|app: 0|req: 20/40] 10.222.0.45 () {60 vars in 1210 bytes} [Thu Jun 16 12:20:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:20:06.990491 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi [None req-aad7c250-0f1e-4d7b-9f9e-b7f43d502bc7 admin admin] Calling method '>' {{(pid=103041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:20:07.011832 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: INFO nova.api.openstack.requestlog [None req-aad7c250-0f1e-4d7b-9f9e-b7f43d502bc7 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024963 Jun 16 12:20:07.012352 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: [pid: 103041|app: 0|req: 21/41] 10.222.0.45 () {60 vars in 1210 bytes} [Thu Jun 16 12:20:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:20:07.022705 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi [None req-a7a7a78c-9b27-4190-bf3c-05e16fc861e8 admin admin] Calling method '>' {{(pid=103040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:20:07.028981 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: INFO nova.api.openstack.wsgi [None req-a7a7a78c-9b27-4190-bf3c-05e16fc861e8 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 16 12:20:07.032261 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi [None req-a7a7a78c-9b27-4190-bf3c-05e16fc861e8 admin admin] Request method failure captured: Jun 16 12:20:07.032261 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 16 12:20:07.032261 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: Accept: application/json Jun 16 12:20:07.032261 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: Accept-Encoding: gzip, deflate Jun 16 12:20:07.032261 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: Connection: keep-alive Jun 16 12:20:07.032261 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: Content-Length: 0 Jun 16 12:20:07.032261 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: Host: 10.222.0.45 Jun 16 12:20:07.032261 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: Openstack-Api-Version: compute 2.90 Jun 16 12:20:07.032261 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: Openstack-System-Scope: None Jun 16 12:20:07.032261 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: User-Agent: python-novaclient Jun 16 12:20:07.032261 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: X-Auth-Token: gAAAAABiqx_2H2kKumF0--bTNXeg0iYOB61JhlY0UwV7JU_twaWRKCly8TYIlDRUx2D5G4IIJUgwH5pAfmjiWlxVmeWkwMIAYzaJZMbxSjdD6kYI-q_E-CZvhD-CH5OQ6NE0je0MrP1glnRYkHybEDVxQrP523RI-tboCa9JFGTTDqK6xpnSndc Jun 16 12:20:07.032261 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: X-Domain-Id: None Jun 16 12:20:07.032261 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: X-Domain-Name: None Jun 16 12:20:07.032261 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: X-Identity-Status: Confirmed Jun 16 12:20:07.032261 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: X-Is-Admin-Project: True Jun 16 12:20:07.032261 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 12:20:07.032261 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: X-Project-Domain-Id: default Jun 16 12:20:07.032261 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: X-Project-Domain-Name: Default Jun 16 12:20:07.032261 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: X-Project-Id: cee0088a8bed428783d8d62046ef865c Jun 16 12:20:07.032261 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: X-Project-Name: admin Jun 16 12:20:07.032261 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: X-Role: member,reader,admin Jun 16 12:20:07.032261 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: X-Roles: member,reader,admin Jun 16 12:20:07.033846 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/cee0088a8bed428783d8d62046ef865c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cee0088a8bed428783d8d62046ef865c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_cee0088a8bed428783d8d62046ef865c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cee0088a8bed428783d8d62046ef865c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Jun 16 12:20:07.033846 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: X-Tenant: admin Jun 16 12:20:07.033846 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: X-Tenant-Id: cee0088a8bed428783d8d62046ef865c Jun 16 12:20:07.033846 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: X-Tenant-Name: admin Jun 16 12:20:07.033846 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: X-User: admin Jun 16 12:20:07.033846 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: X-User-Domain-Id: default Jun 16 12:20:07.033846 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: X-User-Domain-Name: Default Jun 16 12:20:07.033846 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: X-User-Id: 40a7364cd5094f4a878e274d7942bef8 Jun 16 12:20:07.033846 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: X-User-Name: admin Jun 16 12:20:07.033846 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: method: > Jun 16 12:20:07.033846 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: exception: Flavor 42 could not be found. Jun 16 12:20:07.033846 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: action_args: {'id': '42'} Jun 16 12:20:07.033846 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: {{(pid=103040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:20:07.033846 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:20:07.035002 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 12:20:07.035002 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 12:20:07.035002 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 12:20:07.035002 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 12:20:07.035002 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 12:20:07.035002 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 12:20:07.035002 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 12:20:07.035002 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 12:20:07.035002 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 12:20:07.035002 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:20:07.035002 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 12:20:07.035002 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 12:20:07.035002 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 16 12:20:07.035002 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi Jun 16 12:20:07.035002 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:20:07.035002 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi Jun 16 12:20:07.035002 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:20:07.035002 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:20:07.035002 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:20:07.036359 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:20:07.036359 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:20:07.036359 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:20:07.036359 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:20:07.036359 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 12:20:07.036359 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:20:07.036359 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 16 12:20:07.036359 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi Jun 16 12:20:07.036359 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:20:07.036359 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi Jun 16 12:20:07.036359 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:20:07.036359 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:20:07.036359 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:20:07.036359 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:20:07.036359 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:20:07.036359 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 16 12:20:07.036359 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi Jun 16 12:20:07.036359 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi [None req-a7a7a78c-9b27-4190-bf3c-05e16fc861e8 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:20:07.037928 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: INFO nova.api.openstack.requestlog [None req-a7a7a78c-9b27-4190-bf3c-05e16fc861e8 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015842 Jun 16 12:20:07.037928 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: [pid: 103040|app: 0|req: 21/42] 10.222.0.45 () {60 vars in 1190 bytes} [Thu Jun 16 12:20:07 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 16 12:20:07.916698 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi [None req-aad7c250-0f1e-4d7b-9f9e-b7f43d502bc7 admin admin] Calling method '>' {{(pid=103041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:20:07.917707 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: INFO nova.api.openstack.requestlog [None req-aad7c250-0f1e-4d7b-9f9e-b7f43d502bc7 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Jun 16 12:20:07.918137 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: [pid: 103041|app: 0|req: 22/43] 10.222.0.45 () {56 vars in 1074 bytes} [Thu Jun 16 12:20:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:20:08.108641 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi [None req-fbd04f0f-75ff-49e0-9d98-b06c59ad82ff admin admin] Calling method '>' {{(pid=103040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:20:08.114408 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: INFO nova.api.openstack.wsgi [None req-fbd04f0f-75ff-49e0-9d98-b06c59ad82ff admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 16 12:20:08.115888 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi [None req-fbd04f0f-75ff-49e0-9d98-b06c59ad82ff admin admin] Request method failure captured: Jun 16 12:20:08.115888 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 16 12:20:08.115888 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: Accept: application/json Jun 16 12:20:08.115888 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: Accept-Encoding: gzip, deflate Jun 16 12:20:08.115888 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: Connection: keep-alive Jun 16 12:20:08.115888 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: Content-Length: 0 Jun 16 12:20:08.115888 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: Host: 10.222.0.45 Jun 16 12:20:08.115888 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: Openstack-Api-Version: compute 2.90 Jun 16 12:20:08.115888 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: Openstack-System-Scope: None Jun 16 12:20:08.115888 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: User-Agent: python-novaclient Jun 16 12:20:08.115888 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: X-Auth-Token: gAAAAABiqx_3OQid129c5REjFnOpv9hZsX16UnfOUAXGSGeqBgINLmwWX3XFfWio4TfIyrgmaSfile-cJyQD9ts9ocK-ofl7YMiPwkzDHwFoGj7UQZgUTIJhoXL3QNFDSl_ERFJ-R22IPogpjL04aNxOcggonp_3CXyae7mj5oEv1AJY89XbiIM Jun 16 12:20:08.115888 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: X-Domain-Id: None Jun 16 12:20:08.115888 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: X-Domain-Name: None Jun 16 12:20:08.115888 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: X-Identity-Status: Confirmed Jun 16 12:20:08.115888 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: X-Is-Admin-Project: True Jun 16 12:20:08.115888 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 12:20:08.115888 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: X-Project-Domain-Id: default Jun 16 12:20:08.115888 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: X-Project-Domain-Name: Default Jun 16 12:20:08.115888 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: X-Project-Id: cee0088a8bed428783d8d62046ef865c Jun 16 12:20:08.115888 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: X-Project-Name: admin Jun 16 12:20:08.115888 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: X-Role: member,reader,admin Jun 16 12:20:08.115888 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: X-Roles: member,reader,admin Jun 16 12:20:08.117232 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/cee0088a8bed428783d8d62046ef865c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cee0088a8bed428783d8d62046ef865c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_cee0088a8bed428783d8d62046ef865c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cee0088a8bed428783d8d62046ef865c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Jun 16 12:20:08.117232 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: X-Tenant: admin Jun 16 12:20:08.117232 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: X-Tenant-Id: cee0088a8bed428783d8d62046ef865c Jun 16 12:20:08.117232 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: X-Tenant-Name: admin Jun 16 12:20:08.117232 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: X-User: admin Jun 16 12:20:08.117232 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: X-User-Domain-Id: default Jun 16 12:20:08.117232 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: X-User-Domain-Name: Default Jun 16 12:20:08.117232 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: X-User-Id: 40a7364cd5094f4a878e274d7942bef8 Jun 16 12:20:08.117232 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: X-User-Name: admin Jun 16 12:20:08.117232 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: method: > Jun 16 12:20:08.117232 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: exception: Flavor 84 could not be found. Jun 16 12:20:08.117232 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: action_args: {'id': '84'} Jun 16 12:20:08.117232 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: {{(pid=103040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:20:08.117232 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:20:08.118109 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 12:20:08.118109 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 12:20:08.118109 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 12:20:08.118109 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 12:20:08.118109 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 12:20:08.118109 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 12:20:08.118109 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 12:20:08.118109 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 12:20:08.118109 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 12:20:08.118109 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:20:08.118109 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 12:20:08.118109 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 12:20:08.118109 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 16 12:20:08.118109 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi Jun 16 12:20:08.118109 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:20:08.118109 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi Jun 16 12:20:08.118109 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:20:08.118109 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:20:08.118109 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:20:08.119163 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:20:08.119163 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:20:08.119163 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:20:08.119163 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:20:08.119163 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 12:20:08.119163 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:20:08.119163 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 16 12:20:08.119163 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi Jun 16 12:20:08.119163 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:20:08.119163 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi Jun 16 12:20:08.119163 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:20:08.119163 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:20:08.119163 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:20:08.119163 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:20:08.119163 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:20:08.119163 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 16 12:20:08.119163 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi Jun 16 12:20:08.119163 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi [None req-fbd04f0f-75ff-49e0-9d98-b06c59ad82ff admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:20:08.120190 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: INFO nova.api.openstack.requestlog [None req-fbd04f0f-75ff-49e0-9d98-b06c59ad82ff admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.060620 Jun 16 12:20:08.120190 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: [pid: 103040|app: 0|req: 22/44] 10.222.0.45 () {60 vars in 1190 bytes} [Thu Jun 16 12:20:08 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 12:20:08.126840 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi [None req-f960f6ae-d53d-44de-a724-d7c50ce1cdc3 admin admin] Calling method '>' {{(pid=103041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:20:08.142078 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: INFO nova.api.openstack.requestlog [None req-f960f6ae-d53d-44de-a724-d7c50ce1cdc3 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018818 Jun 16 12:20:08.142612 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: [pid: 103041|app: 0|req: 23/45] 10.222.0.45 () {60 vars in 1210 bytes} [Thu Jun 16 12:20:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:20:08.152551 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi [None req-1c85e19b-396e-4f7f-83a6-8279f0cfc391 admin admin] Calling method '>' {{(pid=103040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:20:08.167106 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: INFO nova.api.openstack.requestlog [None req-1c85e19b-396e-4f7f-83a6-8279f0cfc391 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018111 Jun 16 12:20:08.167625 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: [pid: 103040|app: 0|req: 23/46] 10.222.0.45 () {60 vars in 1210 bytes} [Thu Jun 16 12:20:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:20:08.176551 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi [None req-008df936-a5a5-40b8-ba00-dccf933c7c51 admin admin] Calling method '>' {{(pid=103041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:20:08.181846 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: INFO nova.api.openstack.wsgi [None req-008df936-a5a5-40b8-ba00-dccf933c7c51 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 16 12:20:08.183368 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi [None req-008df936-a5a5-40b8-ba00-dccf933c7c51 admin admin] Request method failure captured: Jun 16 12:20:08.183368 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 16 12:20:08.183368 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: Accept: application/json Jun 16 12:20:08.183368 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: Accept-Encoding: gzip, deflate Jun 16 12:20:08.183368 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: Connection: keep-alive Jun 16 12:20:08.183368 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: Content-Length: 0 Jun 16 12:20:08.183368 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: Host: 10.222.0.45 Jun 16 12:20:08.183368 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: Openstack-Api-Version: compute 2.90 Jun 16 12:20:08.183368 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: Openstack-System-Scope: None Jun 16 12:20:08.183368 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: User-Agent: python-novaclient Jun 16 12:20:08.183368 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: X-Auth-Token: gAAAAABiqx_3OQid129c5REjFnOpv9hZsX16UnfOUAXGSGeqBgINLmwWX3XFfWio4TfIyrgmaSfile-cJyQD9ts9ocK-ofl7YMiPwkzDHwFoGj7UQZgUTIJhoXL3QNFDSl_ERFJ-R22IPogpjL04aNxOcggonp_3CXyae7mj5oEv1AJY89XbiIM Jun 16 12:20:08.183368 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: X-Domain-Id: None Jun 16 12:20:08.183368 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: X-Domain-Name: None Jun 16 12:20:08.183368 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: X-Identity-Status: Confirmed Jun 16 12:20:08.183368 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: X-Is-Admin-Project: True Jun 16 12:20:08.183368 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 12:20:08.183368 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: X-Project-Domain-Id: default Jun 16 12:20:08.183368 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: X-Project-Domain-Name: Default Jun 16 12:20:08.183368 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: X-Project-Id: cee0088a8bed428783d8d62046ef865c Jun 16 12:20:08.183368 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: X-Project-Name: admin Jun 16 12:20:08.183368 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: X-Role: member,reader,admin Jun 16 12:20:08.183368 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: X-Roles: member,reader,admin Jun 16 12:20:08.184934 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/cee0088a8bed428783d8d62046ef865c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cee0088a8bed428783d8d62046ef865c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_cee0088a8bed428783d8d62046ef865c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cee0088a8bed428783d8d62046ef865c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Jun 16 12:20:08.184934 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: X-Tenant: admin Jun 16 12:20:08.184934 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: X-Tenant-Id: cee0088a8bed428783d8d62046ef865c Jun 16 12:20:08.184934 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: X-Tenant-Name: admin Jun 16 12:20:08.184934 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: X-User: admin Jun 16 12:20:08.184934 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: X-User-Domain-Id: default Jun 16 12:20:08.184934 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: X-User-Domain-Name: Default Jun 16 12:20:08.184934 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: X-User-Id: 40a7364cd5094f4a878e274d7942bef8 Jun 16 12:20:08.184934 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: X-User-Name: admin Jun 16 12:20:08.184934 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: method: > Jun 16 12:20:08.184934 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: exception: Flavor 84 could not be found. Jun 16 12:20:08.184934 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: action_args: {'id': '84'} Jun 16 12:20:08.184934 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: {{(pid=103041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:20:08.184934 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:20:08.186081 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 12:20:08.186081 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 12:20:08.186081 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 12:20:08.186081 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 12:20:08.186081 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 12:20:08.186081 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 12:20:08.186081 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 12:20:08.186081 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 12:20:08.186081 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 12:20:08.186081 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:20:08.186081 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 12:20:08.186081 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 12:20:08.186081 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 16 12:20:08.186081 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi Jun 16 12:20:08.186081 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:20:08.186081 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi Jun 16 12:20:08.186081 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:20:08.186081 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:20:08.186081 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:20:08.187378 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:20:08.187378 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:20:08.187378 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:20:08.187378 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:20:08.187378 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 12:20:08.187378 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:20:08.187378 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 16 12:20:08.187378 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi Jun 16 12:20:08.187378 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:20:08.187378 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi Jun 16 12:20:08.187378 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:20:08.187378 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:20:08.187378 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:20:08.187378 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:20:08.187378 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:20:08.187378 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 16 12:20:08.187378 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi Jun 16 12:20:08.187378 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi [None req-008df936-a5a5-40b8-ba00-dccf933c7c51 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:20:08.188670 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: INFO nova.api.openstack.requestlog [None req-008df936-a5a5-40b8-ba00-dccf933c7c51 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011718 Jun 16 12:20:08.188670 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: [pid: 103041|app: 0|req: 24/47] 10.222.0.45 () {60 vars in 1190 bytes} [Thu Jun 16 12:20:08 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 16 12:20:09.116851 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi [None req-1c85e19b-396e-4f7f-83a6-8279f0cfc391 admin admin] Calling method '>' {{(pid=103040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:20:09.117850 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: INFO nova.api.openstack.requestlog [None req-1c85e19b-396e-4f7f-83a6-8279f0cfc391 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Jun 16 12:20:09.118259 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: [pid: 103040|app: 0|req: 24/48] 10.222.0.45 () {56 vars in 1074 bytes} [Thu Jun 16 12:20:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:20:09.307474 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi [None req-b2a1ccdd-7599-492e-9320-2b4938b05ed3 admin admin] Calling method '>' {{(pid=103041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:20:09.313267 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: INFO nova.api.openstack.wsgi [None req-b2a1ccdd-7599-492e-9320-2b4938b05ed3 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 16 12:20:09.314805 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi [None req-b2a1ccdd-7599-492e-9320-2b4938b05ed3 admin admin] Request method failure captured: Jun 16 12:20:09.314805 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 16 12:20:09.314805 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: Accept: application/json Jun 16 12:20:09.314805 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: Accept-Encoding: gzip, deflate Jun 16 12:20:09.314805 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: Connection: keep-alive Jun 16 12:20:09.314805 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: Content-Length: 0 Jun 16 12:20:09.314805 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: Host: 10.222.0.45 Jun 16 12:20:09.314805 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: Openstack-Api-Version: compute 2.90 Jun 16 12:20:09.314805 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: Openstack-System-Scope: None Jun 16 12:20:09.314805 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: User-Agent: python-novaclient Jun 16 12:20:09.314805 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: X-Auth-Token: gAAAAABiqx_5pwRwoPweDJdxofJICbhg9Vb9mBVA-6xPpXKwHnFzIIUPp7zv5VAYYZ2SLSyVVA5Dz_y48Tf175lEJ8A848ZS9SYaBqNNfHQaAcD2MS4f3Ot2IbF17q23xCLYSxeKEtRtnU-Q40RP7BTsMf2iYFtbkHW_1VXRMbZrcf9JeIM7SSE Jun 16 12:20:09.314805 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: X-Domain-Id: None Jun 16 12:20:09.314805 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: X-Domain-Name: None Jun 16 12:20:09.314805 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: X-Identity-Status: Confirmed Jun 16 12:20:09.314805 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: X-Is-Admin-Project: True Jun 16 12:20:09.314805 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 12:20:09.314805 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: X-Project-Domain-Id: default Jun 16 12:20:09.314805 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: X-Project-Domain-Name: Default Jun 16 12:20:09.314805 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: X-Project-Id: cee0088a8bed428783d8d62046ef865c Jun 16 12:20:09.314805 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: X-Project-Name: admin Jun 16 12:20:09.314805 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: X-Role: member,reader,admin Jun 16 12:20:09.314805 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: X-Roles: member,reader,admin Jun 16 12:20:09.317177 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/cee0088a8bed428783d8d62046ef865c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cee0088a8bed428783d8d62046ef865c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_cee0088a8bed428783d8d62046ef865c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cee0088a8bed428783d8d62046ef865c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Jun 16 12:20:09.317177 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: X-Tenant: admin Jun 16 12:20:09.317177 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: X-Tenant-Id: cee0088a8bed428783d8d62046ef865c Jun 16 12:20:09.317177 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: X-Tenant-Name: admin Jun 16 12:20:09.317177 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: X-User: admin Jun 16 12:20:09.317177 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: X-User-Domain-Id: default Jun 16 12:20:09.317177 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: X-User-Domain-Name: Default Jun 16 12:20:09.317177 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: X-User-Id: 40a7364cd5094f4a878e274d7942bef8 Jun 16 12:20:09.317177 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: X-User-Name: admin Jun 16 12:20:09.317177 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: method: > Jun 16 12:20:09.317177 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: exception: Flavor 451 could not be found. Jun 16 12:20:09.317177 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: action_args: {'id': '451'} Jun 16 12:20:09.317177 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: {{(pid=103041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:20:09.317177 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:20:09.318520 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 12:20:09.318520 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 12:20:09.318520 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 12:20:09.318520 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 12:20:09.318520 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 12:20:09.318520 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 12:20:09.318520 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 12:20:09.318520 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 12:20:09.318520 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 12:20:09.318520 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:20:09.318520 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 12:20:09.318520 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 12:20:09.318520 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 16 12:20:09.318520 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi Jun 16 12:20:09.318520 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:20:09.318520 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi Jun 16 12:20:09.318520 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:20:09.318520 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:20:09.318520 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:20:09.319894 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:20:09.319894 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:20:09.319894 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:20:09.319894 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:20:09.319894 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 12:20:09.319894 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:20:09.319894 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 16 12:20:09.319894 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi Jun 16 12:20:09.319894 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:20:09.319894 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi Jun 16 12:20:09.319894 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:20:09.319894 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:20:09.319894 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:20:09.319894 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:20:09.319894 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:20:09.319894 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 16 12:20:09.319894 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: ERROR nova.api.openstack.wsgi Jun 16 12:20:09.319894 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi [None req-b2a1ccdd-7599-492e-9320-2b4938b05ed3 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:20:09.321130 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: INFO nova.api.openstack.requestlog [None req-b2a1ccdd-7599-492e-9320-2b4938b05ed3 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.059954 Jun 16 12:20:09.321130 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: [pid: 103041|app: 0|req: 25/49] 10.222.0.45 () {60 vars in 1193 bytes} [Thu Jun 16 12:20:09 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 12:20:09.326678 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi [None req-87629d09-1ae6-4302-b282-30a70936b63a admin admin] Calling method '>' {{(pid=103040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:20:09.342597 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: INFO nova.api.openstack.requestlog [None req-87629d09-1ae6-4302-b282-30a70936b63a admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019565 Jun 16 12:20:09.343125 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: [pid: 103040|app: 0|req: 25/50] 10.222.0.45 () {60 vars in 1210 bytes} [Thu Jun 16 12:20:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:20:09.352950 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi [None req-4a82071a-b0d9-4a3f-91fc-a2750670d174 admin admin] Calling method '>' {{(pid=103041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:20:09.369395 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: INFO nova.api.openstack.requestlog [None req-4a82071a-b0d9-4a3f-91fc-a2750670d174 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020022 Jun 16 12:20:09.369955 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: [pid: 103041|app: 0|req: 26/51] 10.222.0.45 () {60 vars in 1210 bytes} [Thu Jun 16 12:20:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:20:09.380442 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi [None req-b1bea2e3-ecce-4a83-93e4-f002326fbf48 admin admin] Calling method '>' {{(pid=103040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:20:09.385741 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: INFO nova.api.openstack.wsgi [None req-b1bea2e3-ecce-4a83-93e4-f002326fbf48 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 16 12:20:09.387247 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi [None req-b1bea2e3-ecce-4a83-93e4-f002326fbf48 admin admin] Request method failure captured: Jun 16 12:20:09.387247 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 16 12:20:09.387247 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: Accept: application/json Jun 16 12:20:09.387247 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: Accept-Encoding: gzip, deflate Jun 16 12:20:09.387247 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: Connection: keep-alive Jun 16 12:20:09.387247 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: Content-Length: 0 Jun 16 12:20:09.387247 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: Host: 10.222.0.45 Jun 16 12:20:09.387247 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: Openstack-Api-Version: compute 2.90 Jun 16 12:20:09.387247 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: Openstack-System-Scope: None Jun 16 12:20:09.387247 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: User-Agent: python-novaclient Jun 16 12:20:09.387247 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: X-Auth-Token: gAAAAABiqx_5pwRwoPweDJdxofJICbhg9Vb9mBVA-6xPpXKwHnFzIIUPp7zv5VAYYZ2SLSyVVA5Dz_y48Tf175lEJ8A848ZS9SYaBqNNfHQaAcD2MS4f3Ot2IbF17q23xCLYSxeKEtRtnU-Q40RP7BTsMf2iYFtbkHW_1VXRMbZrcf9JeIM7SSE Jun 16 12:20:09.387247 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: X-Domain-Id: None Jun 16 12:20:09.387247 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: X-Domain-Name: None Jun 16 12:20:09.387247 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: X-Identity-Status: Confirmed Jun 16 12:20:09.387247 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: X-Is-Admin-Project: True Jun 16 12:20:09.387247 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 12:20:09.387247 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: X-Project-Domain-Id: default Jun 16 12:20:09.387247 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: X-Project-Domain-Name: Default Jun 16 12:20:09.387247 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: X-Project-Id: cee0088a8bed428783d8d62046ef865c Jun 16 12:20:09.387247 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: X-Project-Name: admin Jun 16 12:20:09.387247 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: X-Role: member,reader,admin Jun 16 12:20:09.387247 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: X-Roles: member,reader,admin Jun 16 12:20:09.388836 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/cee0088a8bed428783d8d62046ef865c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cee0088a8bed428783d8d62046ef865c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_cee0088a8bed428783d8d62046ef865c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cee0088a8bed428783d8d62046ef865c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Jun 16 12:20:09.388836 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: X-Tenant: admin Jun 16 12:20:09.388836 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: X-Tenant-Id: cee0088a8bed428783d8d62046ef865c Jun 16 12:20:09.388836 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: X-Tenant-Name: admin Jun 16 12:20:09.388836 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: X-User: admin Jun 16 12:20:09.388836 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: X-User-Domain-Id: default Jun 16 12:20:09.388836 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: X-User-Domain-Name: Default Jun 16 12:20:09.388836 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: X-User-Id: 40a7364cd5094f4a878e274d7942bef8 Jun 16 12:20:09.388836 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: X-User-Name: admin Jun 16 12:20:09.388836 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: method: > Jun 16 12:20:09.388836 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: exception: Flavor 451 could not be found. Jun 16 12:20:09.388836 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: action_args: {'id': '451'} Jun 16 12:20:09.388836 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: {{(pid=103040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:20:09.388836 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:20:09.389862 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 12:20:09.389862 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 12:20:09.389862 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 12:20:09.389862 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 12:20:09.389862 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 12:20:09.389862 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 12:20:09.389862 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 12:20:09.389862 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 12:20:09.389862 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 12:20:09.389862 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:20:09.389862 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 12:20:09.389862 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 12:20:09.389862 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 16 12:20:09.389862 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi Jun 16 12:20:09.389862 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:20:09.389862 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi Jun 16 12:20:09.389862 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:20:09.389862 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:20:09.389862 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:20:09.391019 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:20:09.391019 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:20:09.391019 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:20:09.391019 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:20:09.391019 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 12:20:09.391019 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:20:09.391019 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 16 12:20:09.391019 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi Jun 16 12:20:09.391019 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:20:09.391019 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi Jun 16 12:20:09.391019 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:20:09.391019 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:20:09.391019 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:20:09.391019 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:20:09.391019 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:20:09.391019 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 16 12:20:09.391019 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: ERROR nova.api.openstack.wsgi Jun 16 12:20:09.391019 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi [None req-b1bea2e3-ecce-4a83-93e4-f002326fbf48 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:20:09.392156 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: INFO nova.api.openstack.requestlog [None req-b1bea2e3-ecce-4a83-93e4-f002326fbf48 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012874 Jun 16 12:20:09.392156 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: [pid: 103040|app: 0|req: 26/52] 10.222.0.45 () {60 vars in 1193 bytes} [Thu Jun 16 12:20:09 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 12:20:10.257003 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi [None req-4a82071a-b0d9-4a3f-91fc-a2750670d174 admin admin] Calling method '>' {{(pid=103041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:20:10.258162 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: INFO nova.api.openstack.requestlog [None req-4a82071a-b0d9-4a3f-91fc-a2750670d174 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Jun 16 12:20:10.258560 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: [pid: 103041|app: 0|req: 27/53] 10.222.0.45 () {56 vars in 1074 bytes} [Thu Jun 16 12:20:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:20:10.447559 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi [None req-3e2fe3c0-7756-42bd-8b2d-d041016dac58 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:20:10.465283 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: INFO nova.api.openstack.requestlog [None req-3e2fe3c0-7756-42bd-8b2d-d041016dac58 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.069157 Jun 16 12:20:10.465816 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: [pid: 103040|app: 0|req: 27/54] 10.222.0.45 () {64 vars in 1235 bytes} [Thu Jun 16 12:20:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 12:20:11.327006 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi [None req-4a82071a-b0d9-4a3f-91fc-a2750670d174 admin admin] Calling method '>' {{(pid=103041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:20:11.328049 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: INFO nova.api.openstack.requestlog [None req-4a82071a-b0d9-4a3f-91fc-a2750670d174 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Jun 16 12:20:11.328472 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: [pid: 103041|app: 0|req: 28/55] 10.222.0.45 () {56 vars in 1074 bytes} [Thu Jun 16 12:20:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:20:11.520413 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi [None req-b5f15022-95b5-4e1e-8ec3-641b3bf1a35a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:20:11.538413 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: INFO nova.api.openstack.requestlog [None req-b5f15022-95b5-4e1e-8ec3-641b3bf1a35a admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.069825 Jun 16 12:20:11.538921 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: [pid: 103040|app: 0|req: 28/56] 10.222.0.45 () {64 vars in 1235 bytes} [Thu Jun 16 12:20:11 2022] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 12:20:12.399689 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi [None req-4a82071a-b0d9-4a3f-91fc-a2750670d174 admin admin] Calling method '>' {{(pid=103041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:20:12.400721 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: INFO nova.api.openstack.requestlog [None req-4a82071a-b0d9-4a3f-91fc-a2750670d174 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Jun 16 12:20:12.401119 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: [pid: 103041|app: 0|req: 29/57] 10.222.0.45 () {56 vars in 1074 bytes} [Thu Jun 16 12:20:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:20:12.593983 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi [None req-2017416a-35eb-4c9a-a796-cf2e74f38fb3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:20:12.611415 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: INFO nova.api.openstack.requestlog [None req-2017416a-35eb-4c9a-a796-cf2e74f38fb3 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.068913 Jun 16 12:20:12.611883 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: [pid: 103040|app: 0|req: 29/58] 10.222.0.45 () {64 vars in 1235 bytes} [Thu Jun 16 12:20:12 2022] POST /compute/v2.1/flavors => generated 407 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 12:20:13.483031 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi [None req-4a82071a-b0d9-4a3f-91fc-a2750670d174 admin admin] Calling method '>' {{(pid=103041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:20:13.484050 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: INFO nova.api.openstack.requestlog [None req-4a82071a-b0d9-4a3f-91fc-a2750670d174 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Jun 16 12:20:13.484442 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: [pid: 103041|app: 0|req: 30/59] 10.222.0.45 () {56 vars in 1074 bytes} [Thu Jun 16 12:20:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:20:13.675353 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi [None req-39fe5256-364e-4a59-b289-840ce79f82e6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:20:13.692914 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: INFO nova.api.openstack.requestlog [None req-39fe5256-364e-4a59-b289-840ce79f82e6 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.069754 Jun 16 12:20:13.693443 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: [pid: 103040|app: 0|req: 30/60] 10.222.0.45 () {64 vars in 1235 bytes} [Thu Jun 16 12:20:13 2022] POST /compute/v2.1/flavors => generated 409 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 12:20:14.555198 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi [None req-4a82071a-b0d9-4a3f-91fc-a2750670d174 admin admin] Calling method '>' {{(pid=103041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:20:14.556247 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: INFO nova.api.openstack.requestlog [None req-4a82071a-b0d9-4a3f-91fc-a2750670d174 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Jun 16 12:20:14.556644 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: [pid: 103041|app: 0|req: 31/61] 10.222.0.45 () {56 vars in 1074 bytes} [Thu Jun 16 12:20:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:20:14.748073 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi [None req-81f598e0-7583-444d-b4b6-8487318ecb70 admin admin] Calling method '>' {{(pid=103040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:20:14.766775 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: INFO nova.api.openstack.requestlog [None req-81f598e0-7583-444d-b4b6-8487318ecb70 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069992 Jun 16 12:20:14.767298 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: [pid: 103040|app: 0|req: 31/62] 10.222.0.45 () {60 vars in 1202 bytes} [Thu Jun 16 12:20:14 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:21:02.629481 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi [None req-4a82071a-b0d9-4a3f-91fc-a2750670d174 admin admin] Calling method '>' {{(pid=103041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:21:02.630693 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: INFO nova.api.openstack.requestlog [None req-4a82071a-b0d9-4a3f-91fc-a2750670d174 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001608 Jun 16 12:21:02.630970 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: [pid: 103041|app: 0|req: 32/63] 10.222.0.45 () {54 vars in 930 bytes} [Thu Jun 16 12:21:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 12:21:02.641449 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG dbcounter [-] [103040] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:21:02.690821 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi [None req-dbc079bf-2359-45ae-9f5d-7c8c1c230f3a admin admin] Calling method '>' {{(pid=103040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:21:02.710129 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: INFO nova.api.openstack.requestlog [None req-dbc079bf-2359-45ae-9f5d-7c8c1c230f3a admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.073043 Jun 16 12:21:02.710653 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: [pid: 103040|app: 0|req: 32/64] 10.222.0.45 () {60 vars in 1291 bytes} [Thu Jun 16 12:21:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:21:02.733361 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi [None req-65fbbdae-7b90-4401-a345-677ae5faae00 admin admin] Calling method '>' {{(pid=103041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:21:02.737459 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG dbcounter [-] [103041] Writing DB stats nova_api:SELECT=14 {{(pid=103041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:21:02.742842 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: INFO nova.api.openstack.requestlog [None req-65fbbdae-7b90-4401-a345-677ae5faae00 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013063 Jun 16 12:21:02.743365 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: [pid: 103041|app: 0|req: 33/65] 10.222.0.45 () {60 vars in 1282 bytes} [Thu Jun 16 12:21:02 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:21:02.755207 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi [None req-af9d13a9-3230-4864-ba11-f448ebbae0eb admin admin] Calling method '>' {{(pid=103040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:21:02.762717 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: INFO nova.api.openstack.requestlog [None req-af9d13a9-3230-4864-ba11-f448ebbae0eb admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011713 Jun 16 12:21:02.763224 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: [pid: 103040|app: 0|req: 33/66] 10.222.0.45 () {60 vars in 1285 bytes} [Thu Jun 16 12:21:02 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:21:02.774695 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi [None req-e50dd1c6-a1f3-424f-811b-5993957e7861 admin admin] Calling method '>' {{(pid=103041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:21:02.782252 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: INFO nova.api.openstack.requestlog [None req-e50dd1c6-a1f3-424f-811b-5993957e7861 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011411 Jun 16 12:21:02.782757 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: [pid: 103041|app: 0|req: 34/67] 10.222.0.45 () {60 vars in 1285 bytes} [Thu Jun 16 12:21:02 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:21:02.793724 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi [None req-34efe628-37c2-4cfc-bfd7-0dcd78857a39 admin admin] Calling method '>' {{(pid=103040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:21:02.801651 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: INFO nova.api.openstack.requestlog [None req-34efe628-37c2-4cfc-bfd7-0dcd78857a39 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011375 Jun 16 12:21:02.802185 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: [pid: 103040|app: 0|req: 34/68] 10.222.0.45 () {60 vars in 1282 bytes} [Thu Jun 16 12:21:02 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:24:34.972470 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi [None req-e50dd1c6-a1f3-424f-811b-5993957e7861 admin admin] Calling method '>' {{(pid=103041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:24:34.973492 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: INFO nova.api.openstack.requestlog [None req-e50dd1c6-a1f3-424f-811b-5993957e7861 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jun 16 12:24:34.973908 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: [pid: 103041|app: 0|req: 35/69] 10.222.0.45 () {56 vars in 1074 bytes} [Thu Jun 16 12:24:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:24:35.129425 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG dbcounter [-] [103040] Writing DB stats nova_api:SELECT=6 {{(pid=103040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:24:35.244662 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi [None req-3ae37e11-734a-4e10-94a3-65d41e2fc64f admin admin] Calling method '>' {{(pid=103040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:24:35.245817 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 12:24:35.245817 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: warnings.warn(msg) Jun 16 12:24:35.247039 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG oslo_concurrency.lockutils [None req-3ae37e11-734a-4e10-94a3-65d41e2fc64f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:24:35.247479 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG oslo_concurrency.lockutils [None req-3ae37e11-734a-4e10-94a3-65d41e2fc64f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:24:35.248265 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG oslo_concurrency.lockutils [None req-3ae37e11-734a-4e10-94a3-65d41e2fc64f admin admin] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:24:35.248696 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG oslo_concurrency.lockutils [None req-3ae37e11-734a-4e10-94a3-65d41e2fc64f admin admin] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:24:35.281709 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: INFO nova.api.openstack.requestlog [None req-3ae37e11-734a-4e10-94a3-65d41e2fc64f admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.153815 Jun 16 12:24:35.282281 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: [pid: 103040|app: 0|req: 35/70] 10.222.0.45 () {60 vars in 1193 bytes} [Thu Jun 16 12:24:35 2022] GET /compute/v2.1/os-services => generated 791 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 12:24:36.162377 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi [None req-e50dd1c6-a1f3-424f-811b-5993957e7861 admin admin] Calling method '>' {{(pid=103041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:24:36.163677 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: INFO nova.api.openstack.requestlog [None req-e50dd1c6-a1f3-424f-811b-5993957e7861 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001705 Jun 16 12:24:36.164073 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: [pid: 103041|app: 0|req: 36/71] 10.222.0.45 () {56 vars in 1074 bytes} [Thu Jun 16 12:24:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:24:36.355601 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi [None req-d422f3ab-42bb-4b56-b7ee-886d7f4b5958 admin admin] Calling method '>' {{(pid=103040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:24:36.356771 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 12:24:36.356771 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: warnings.warn(msg) Jun 16 12:24:36.357998 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG oslo_concurrency.lockutils [None req-d422f3ab-42bb-4b56-b7ee-886d7f4b5958 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:24:36.359014 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG oslo_concurrency.lockutils [None req-d422f3ab-42bb-4b56-b7ee-886d7f4b5958 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:24:36.359807 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG oslo_concurrency.lockutils [None req-d422f3ab-42bb-4b56-b7ee-886d7f4b5958 admin admin] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:24:36.360243 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG oslo_concurrency.lockutils [None req-d422f3ab-42bb-4b56-b7ee-886d7f4b5958 admin admin] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:24:36.380064 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: INFO nova.api.openstack.requestlog [None req-d422f3ab-42bb-4b56-b7ee-886d7f4b5958 admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.075688 Jun 16 12:24:36.380563 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: [pid: 103040|app: 0|req: 36/72] 10.222.0.45 () {60 vars in 1193 bytes} [Thu Jun 16 12:24:36 2022] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 12:24:47.681101 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi [None req-e50dd1c6-a1f3-424f-811b-5993957e7861 admin admin] Calling method '>' {{(pid=103041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:24:47.682132 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: INFO nova.api.openstack.requestlog [None req-e50dd1c6-a1f3-424f-811b-5993957e7861 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Jun 16 12:24:47.682531 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: [pid: 103041|app: 0|req: 37/73] 10.222.0.45 () {56 vars in 1074 bytes} [Thu Jun 16 12:24:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:24:47.824734 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG dbcounter [-] [103040] Writing DB stats nova_cell0:SELECT=4 {{(pid=103040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:24:47.825433 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG dbcounter [-] [103040] Writing DB stats nova_cell1:SELECT=4 {{(pid=103040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:24:47.826090 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG dbcounter [-] [103040] Writing DB stats nova_api:SELECT=8 {{(pid=103040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:24:47.874726 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi [None req-44b3c45b-438f-4854-b6e8-af653832257e admin admin] Calling method '>' {{(pid=103040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:24:47.875937 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 12:24:47.875937 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: warnings.warn(msg) Jun 16 12:24:47.877118 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG oslo_concurrency.lockutils [None req-44b3c45b-438f-4854-b6e8-af653832257e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:24:47.877564 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG oslo_concurrency.lockutils [None req-44b3c45b-438f-4854-b6e8-af653832257e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:24:47.878384 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG oslo_concurrency.lockutils [None req-44b3c45b-438f-4854-b6e8-af653832257e admin admin] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:24:47.878818 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG oslo_concurrency.lockutils [None req-44b3c45b-438f-4854-b6e8-af653832257e admin admin] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:24:47.903896 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: INFO nova.api.openstack.requestlog [None req-44b3c45b-438f-4854-b6e8-af653832257e admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.083393 Jun 16 12:24:47.904383 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: [pid: 103040|app: 0|req: 37/74] 10.222.0.45 () {60 vars in 1193 bytes} [Thu Jun 16 12:24:47 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:24:48.791851 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: DEBUG nova.api.openstack.wsgi [None req-e50dd1c6-a1f3-424f-811b-5993957e7861 admin admin] Calling method '>' {{(pid=103041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:24:48.792914 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: INFO nova.api.openstack.requestlog [None req-e50dd1c6-a1f3-424f-811b-5993957e7861 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Jun 16 12:24:48.793313 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: [pid: 103041|app: 0|req: 38/75] 10.222.0.45 () {56 vars in 1074 bytes} [Thu Jun 16 12:24:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:24:48.987201 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG nova.api.openstack.wsgi [None req-b6f35ca2-4dbc-4100-8ffa-9d7f6fcd7d75 admin admin] Calling method '>' {{(pid=103040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:24:48.988351 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 12:24:48.988351 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: warnings.warn(msg) Jun 16 12:24:48.989527 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG oslo_concurrency.lockutils [None req-b6f35ca2-4dbc-4100-8ffa-9d7f6fcd7d75 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:24:48.989994 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG oslo_concurrency.lockutils [None req-b6f35ca2-4dbc-4100-8ffa-9d7f6fcd7d75 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:24:48.990779 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG oslo_concurrency.lockutils [None req-b6f35ca2-4dbc-4100-8ffa-9d7f6fcd7d75 admin admin] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:24:48.991208 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: DEBUG oslo_concurrency.lockutils [None req-b6f35ca2-4dbc-4100-8ffa-9d7f6fcd7d75 admin admin] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:24:49.012834 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: INFO nova.api.openstack.requestlog [None req-b6f35ca2-4dbc-4100-8ffa-9d7f6fcd7d75 admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.078924 Jun 16 12:24:49.013372 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: [pid: 103040|app: 0|req: 38/76] 10.222.0.45 () {60 vars in 1193 bytes} [Thu Jun 16 12:24:48 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:25:44.815256 dv-cinder-846149-2-iscsi devstack@n-api.service[103039]: Thu Jun 16 12:25:44 2022 - graceful shutdown triggered... Jun 16 12:25:44.815380 dv-cinder-846149-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 16 12:25:44.816367 dv-cinder-846149-2-iscsi devstack@n-api.service[103040]: Gracefully killing worker 1 (pid: 103040)... Jun 16 12:25:44.817300 dv-cinder-846149-2-iscsi devstack@n-api.service[103041]: Gracefully killing worker 2 (pid: 103041)... Jun 16 12:25:45.816682 dv-cinder-846149-2-iscsi devstack@n-api.service[103039]: worker 1 buried after 1 seconds Jun 16 12:25:45.817223 dv-cinder-846149-2-iscsi devstack@n-api.service[103039]: worker 2 buried after 1 seconds Jun 16 12:25:45.817223 dv-cinder-846149-2-iscsi devstack@n-api.service[103039]: goodbye to uWSGI. Jun 16 12:25:45.818308 dv-cinder-846149-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 16 12:25:45.818869 dv-cinder-846149-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 16 12:25:45.821628 dv-cinder-846149-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 16 12:25:45.831502 dv-cinder-846149-2-iscsi devstack@n-api.service[117590]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 16 12:25:45.833499 dv-cinder-846149-2-iscsi devstack@n-api.service[117590]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 16 12:25:45 2022] *** Jun 16 12:25:45.833499 dv-cinder-846149-2-iscsi devstack@n-api.service[117590]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 16 12:25:45.833499 dv-cinder-846149-2-iscsi devstack@n-api.service[117590]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 16 12:25:45.833499 dv-cinder-846149-2-iscsi devstack@n-api.service[117590]: nodename: dv-cinder-846149-2-iscsi Jun 16 12:25:45.833499 dv-cinder-846149-2-iscsi devstack@n-api.service[117590]: machine: x86_64 Jun 16 12:25:45.833499 dv-cinder-846149-2-iscsi devstack@n-api.service[117590]: clock source: unix Jun 16 12:25:45.833499 dv-cinder-846149-2-iscsi devstack@n-api.service[117590]: pcre jit disabled Jun 16 12:25:45.833499 dv-cinder-846149-2-iscsi devstack@n-api.service[117590]: detected number of CPU cores: 4 Jun 16 12:25:45.833499 dv-cinder-846149-2-iscsi devstack@n-api.service[117590]: current working directory: / Jun 16 12:25:45.833499 dv-cinder-846149-2-iscsi devstack@n-api.service[117590]: detected binary path: /usr/bin/uwsgi-core Jun 16 12:25:45.834181 dv-cinder-846149-2-iscsi devstack@n-api.service[117590]: your processes number limit is 47680 Jun 16 12:25:45.834181 dv-cinder-846149-2-iscsi devstack@n-api.service[117590]: your memory page size is 4096 bytes Jun 16 12:25:45.834181 dv-cinder-846149-2-iscsi devstack@n-api.service[117590]: detected max file descriptor number: 2048 Jun 16 12:25:45.834181 dv-cinder-846149-2-iscsi devstack@n-api.service[117590]: lock engine: pthread robust mutexes Jun 16 12:25:45.834181 dv-cinder-846149-2-iscsi devstack@n-api.service[117590]: thunder lock: enabled Jun 16 12:25:45.834181 dv-cinder-846149-2-iscsi devstack@n-api.service[117590]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 16 12:25:45.834181 dv-cinder-846149-2-iscsi devstack@n-api.service[117590]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 16 12:25:45.878549 dv-cinder-846149-2-iscsi devstack@n-api.service[117590]: Python main interpreter initialized at 0x55664b4ab9c0 Jun 16 12:25:45.878549 dv-cinder-846149-2-iscsi devstack@n-api.service[117590]: python threads support enabled Jun 16 12:25:45.878549 dv-cinder-846149-2-iscsi devstack@n-api.service[117590]: your server socket listen backlog is limited to 100 connections Jun 16 12:25:45.878549 dv-cinder-846149-2-iscsi devstack@n-api.service[117590]: your mercy for graceful operations on workers is 90 seconds Jun 16 12:25:45.878993 dv-cinder-846149-2-iscsi devstack@n-api.service[117590]: mapped 403077 bytes (393 KB) for 2 cores Jun 16 12:25:45.878993 dv-cinder-846149-2-iscsi devstack@n-api.service[117590]: *** Operational MODE: preforking *** Jun 16 12:25:45.879274 dv-cinder-846149-2-iscsi devstack@n-api.service[117590]: *** uWSGI is running in multiple interpreter mode *** Jun 16 12:25:45.879274 dv-cinder-846149-2-iscsi devstack@n-api.service[117590]: spawned uWSGI master process (pid: 117590) Jun 16 12:25:45.879483 dv-cinder-846149-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 16 12:25:45.880210 dv-cinder-846149-2-iscsi devstack@n-api.service[117590]: spawned uWSGI worker 1 (pid: 117606, cores: 1) Jun 16 12:25:45.880407 dv-cinder-846149-2-iscsi devstack@n-api.service[117590]: spawned uWSGI worker 2 (pid: 117607, cores: 1) Jun 16 12:25:45.880576 dv-cinder-846149-2-iscsi devstack@n-api.service[117590]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 16 12:25:46.547034 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 12:25:46.554218 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 12:25:47.798720 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 12:25:47.798720 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: from cryptography.utils import int_from_bytes Jun 16 12:25:47.799394 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 12:25:47.799394 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: from cryptography.utils import int_from_bytes Jun 16 12:25:47.824339 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 12:25:47.824339 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: from cryptography.utils import int_from_bytes Jun 16 12:25:47.824957 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 12:25:47.824957 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: from cryptography.utils import int_from_bytes Jun 16 12:25:50.222220 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 12:25:50.222775 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 12:25:50.223075 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 12:25:50.223268 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 12:25:50.223529 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 12:25:50.223915 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.224238 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.224558 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.224877 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.225206 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.225519 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.225840 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.226181 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.226510 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.226772 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.227089 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.227413 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846149-2-iscsi {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.227735 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.228042 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.228349 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.228665 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.228975 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.229294 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.229598 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.230130 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.231579 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.231579 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.231579 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.231579 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.231919 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.232133 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.232399 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.232713 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.233026 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.233346 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.233754 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846149-2-iscsi {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.234095 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.234957 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.235299 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.235685 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.235996 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.236305 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.236628 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.236971 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.237303 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.237608 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.237961 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.238307 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.238598 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.238917 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.239226 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.239538 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.239861 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.240173 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.240477 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.240724 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.241021 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.241342 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.241664 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.242010 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.242265 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.242518 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.242839 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.243158 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.243464 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.243798 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.244077 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.244382 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.244688 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.245005 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.245301 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.245603 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.245943 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.246260 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.246580 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.246887 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.247206 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.247601 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.247855 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.248165 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.248504 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.248828 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.249139 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.249457 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.249777 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.250263 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.250700 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.251016 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.251362 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.251679 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.251987 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.252242 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.252548 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.252847 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.253176 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.253481 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.253789 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.254122 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.254426 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.254734 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.255041 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.255389 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.255648 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.255962 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.256256 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.256561 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.256868 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.257174 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.257495 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.257811 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.258152 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.258461 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.258758 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.259059 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.259379 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.259683 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.260405 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.260405 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.260601 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.260877 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.261197 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.261504 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.261806 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.262150 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.262450 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.262754 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.263067 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.263374 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.263675 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.263976 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.264278 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.264597 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.264882 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.265182 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.265560 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.265910 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.266334 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.266661 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.266975 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.267284 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.267591 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.267912 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.268250 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.268595 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.268945 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.269233 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.269565 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.269908 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.270235 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.270549 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.270892 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.271188 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.271496 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.271807 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.272116 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.272436 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.272753 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.273084 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.273437 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.273712 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.274056 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.274221 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 12:25:50.274886 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.275043 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 12:25:50.275213 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.275213 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.275482 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 12:25:50.275732 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.275891 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 12:25:50.275891 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 12:25:50.276232 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.276232 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.276523 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.276679 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.276820 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.276971 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.277125 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.277299 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.277452 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.277593 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.277777 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.278041 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.278198 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.278340 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.278491 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.278725 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.278898 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.279189 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.279328 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.279495 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.279687 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.279839 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.279998 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.280139 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.280278 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846149-2-iscsi {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.280433 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.280573 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.280731 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.280886 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.281683 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.281839 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.282078 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.282296 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.282456 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.282610 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.282752 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.282902 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.283054 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.283201 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.283360 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.283360 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.283741 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.283902 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.284053 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.284210 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.284361 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.284504 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.284655 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.284795 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.284935 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.285092 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.285243 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.285384 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.285538 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.285692 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.285945 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.286178 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.286333 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.286484 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.286636 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.286791 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.286931 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.287344 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.287484 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846149-2-iscsi {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.287632 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.287786 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.287944 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.288189 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.288344 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.288508 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.288661 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.288661 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.289030 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.289322 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.289472 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.289613 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.289764 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.289930 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.290091 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.290233 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.290373 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.290523 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.290663 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.290817 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.290970 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.291128 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.291336 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.291490 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.291642 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.291871 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.292029 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.292181 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.292323 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.292474 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.292626 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.292776 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.292918 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.293066 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.293214 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.293364 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.293506 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.293735 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.293905 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.294048 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.294200 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.294489 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.294676 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.294835 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.294984 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.295134 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.295291 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.295432 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.295581 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.295734 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.295885 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.296133 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.296279 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.296433 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.296596 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.297361 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.297598 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.297756 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.297914 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.298074 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.298230 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.298471 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.298616 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.298766 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.298990 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.299145 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.299419 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.299575 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.299727 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.299882 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.300025 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.300185 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.300328 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.300478 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.300631 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.300792 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.300944 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.301103 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.301245 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.301499 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.301656 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.301798 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.302090 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.302246 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.302346 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.302424 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.302505 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.302579 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.302651 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.302723 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.302803 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.302887 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.302961 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.303041 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.303142 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.303232 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.303319 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.303402 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.303483 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.303557 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.303636 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.304319 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.304423 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.304509 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.304591 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.304666 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.304738 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.304825 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.304901 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.304973 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.305053 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.305134 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.305208 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.305289 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.305365 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.305444 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.305533 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.305606 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.305693 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.305768 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.305848 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.306025 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.306110 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.306185 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.306266 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.306358 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.306446 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.306521 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.306594 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.306665 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.306746 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.306826 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.306907 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.307100 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.307205 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.307407 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.307501 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.307715 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.307800 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.308024 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.308108 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.308332 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.308418 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.308643 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.308739 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.308948 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.309049 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.309268 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.309522 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.309617 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.309692 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.309860 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.310688 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.310856 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.311016 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.311164 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.311401 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.311640 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.311801 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.311958 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.312124 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.312372 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.312538 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.312687 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.312845 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.312994 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.313149 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.313302 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.313459 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.313618 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.313772 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.313772 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.314195 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.314355 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.314504 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.314650 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.314798 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.314944 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.315102 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.315258 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.315413 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.315561 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.315717 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.315871 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.316019 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.316179 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.316337 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.316485 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.316630 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.316776 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.316930 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.317087 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.317347 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.317500 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.317655 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.317813 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.317995 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.318154 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.318312 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.318459 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.318606 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.318861 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.319026 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.319176 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.319411 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.319694 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.319847 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.320015 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.320178 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.320335 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.320483 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.320630 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.320783 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:25:50.320931 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.321086 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.321234 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.321382 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.321528 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.321768 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.322581 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.323400 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.323574 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.323741 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.323893 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.324063 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.324287 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.324680 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.324854 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.325601 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.325763 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.325933 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.326098 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.326246 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.326407 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.326558 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.326705 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.326852 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.327006 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.327160 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.327335 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.327588 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.327751 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.327905 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.328174 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.328368 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.328534 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.328685 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.328840 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.328988 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.329142 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.329297 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.329576 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.330251 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.330418 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.330566 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.330714 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.330884 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.331032 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.331032 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.331310 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.331456 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.331601 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.331777 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.332024 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.332177 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.332332 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.332508 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.332739 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.332901 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.333061 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.333216 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.333363 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.333518 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.333664 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.333826 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.334010 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.334169 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.334411 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.334565 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.334722 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.334880 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.335029 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.335195 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.335343 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.335489 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.335873 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.336027 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.336183 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.336340 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.336496 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.336644 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.336799 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.336956 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.337112 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.337112 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.337414 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.337414 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.337841 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.338027 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.338179 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.338336 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.338492 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.338646 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.338821 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.339458 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.339722 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.340158 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.340324 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.340472 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.340618 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.340765 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.340911 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.341071 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.341221 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.341375 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.341531 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.341771 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.341996 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.342233 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.342394 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.342554 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.342554 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.342554 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.342554 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.343146 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.343301 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.343449 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.344115 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.344268 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.344525 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.344925 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.345088 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.345244 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.345404 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.345404 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.345704 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.345704 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.346017 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.346017 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.346298 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.346298 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.346602 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.346751 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.346906 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.347061 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.347217 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.347387 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.347537 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.347691 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.347839 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.347991 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.348145 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.348145 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.349009 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.349171 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.349321 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.349468 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.349617 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.349913 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.350306 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.350461 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.350620 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.350777 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.350935 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.351083 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.351237 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.351385 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.351532 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.351687 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.351849 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.352007 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.352166 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.352403 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.352557 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.352713 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.352870 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.353027 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.353182 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.353330 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.353476 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.353670 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.353835 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.354383 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.355223 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.355393 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.355554 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.355739 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.355903 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.356061 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.356217 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.356372 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.356530 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.356679 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.356833 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.356989 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.357137 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.357308 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.358010 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.358115 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.358212 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.358311 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.358311 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.358485 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.358485 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.358664 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.358756 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.358841 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.358841 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.359011 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.359011 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.359204 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.359835 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.359929 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.359929 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.360069 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.360150 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.360230 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.360307 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.360378 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.360449 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.360539 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.360632 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.360717 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.360801 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.360884 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.360967 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.361063 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.361150 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.361233 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.361324 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.361416 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.361513 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.361605 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.361695 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.361787 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.361890 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.361995 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.362089 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.362171 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.362251 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.362324 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.362402 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.362474 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.362558 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.362632 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.362703 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.362774 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.362852 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.362934 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.363015 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.363095 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.364383 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.364463 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.364547 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.364636 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.364710 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.364710 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.364848 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.364848 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.364848 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.364848 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.364848 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.364848 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.364848 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.364848 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.365602 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.365602 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.365751 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.365824 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.365928 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.366006 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.366006 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.366147 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.366220 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.366220 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.366347 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.366426 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.366512 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.366592 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.366671 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.366744 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.366823 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.366904 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.367016 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.367099 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.367172 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.367256 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.367256 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.367393 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.367478 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.367552 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.367631 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.367711 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.367784 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.367854 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.367934 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.368013 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.368086 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.368165 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.368244 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.368325 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.368410 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.368525 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.368616 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.368857 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.368964 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.369327 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.369488 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.369606 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.369863 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.370237 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.370397 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.370619 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.370812 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.370974 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.371174 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.371315 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.371501 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.371619 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.371824 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.371922 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.372145 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.372241 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.372467 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.372568 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.372805 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.372916 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.373116 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.373210 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.373428 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.373524 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.373742 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.373845 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.374087 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.374214 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.374401 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.374501 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.374718 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.374850 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.375073 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.375231 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.375365 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.375509 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.375713 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.375833 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.375982 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.376161 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.376295 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.376480 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.376603 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.376801 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.376896 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.377116 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.377211 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.377436 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.377539 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.377751 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.377856 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.378158 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.378347 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.378480 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.378669 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.378804 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.378988 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.379118 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.379332 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.379425 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.379679 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.379781 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.380001 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.380108 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.380347 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.380508 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.380655 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.380860 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.381038 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.381182 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.381299 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.381554 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.381658 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.381892 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.382002 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.382198 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.382290 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.382523 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.382645 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.382841 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.382943 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.383154 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.383247 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.383467 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.383567 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.383775 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.383880 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.384087 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.384180 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.384409 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.384512 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.384721 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.384992 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.385085 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.385326 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.385427 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.385643 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.385776 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.385987 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.386238 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.386343 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.386559 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.386653 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.386874 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.386968 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.387250 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.387342 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.387605 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.387704 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.387915 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.388016 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.388228 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.388334 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.388539 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.388631 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.388847 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.388939 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.389161 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.389267 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.389470 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.389562 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.389780 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.389915 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.390111 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.390217 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.390935 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.391243 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.391342 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.391548 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.391824 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.391923 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.392137 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.392237 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.392448 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.392548 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.392767 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.392870 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.393075 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.393177 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.393396 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.393488 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.393703 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.393882 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.394057 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.394219 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.394369 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.394677 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.394786 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.394981 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.395088 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.395288 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.395388 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.395637 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.395763 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.395950 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.396065 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.396266 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.396369 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.396586 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.396691 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.396899 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.397003 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.397230 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.397332 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.397534 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.397635 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.397851 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.398013 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.398200 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.398303 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.398515 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.398616 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.398822 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.398924 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.399132 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.399238 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.399438 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.399531 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.399744 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.399844 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.400057 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.400172 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.400368 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.400462 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.400680 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.400775 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.400991 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.401100 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.401297 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.401491 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.401597 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.401776 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.401960 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.402119 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.402263 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.402422 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.402568 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.402712 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.402865 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.403003 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.403145 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.403346 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.403496 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.403661 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.403805 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.403988 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.404135 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.404299 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.404445 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.404606 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.404766 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.404917 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.405062 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.405203 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.405349 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.405489 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.405640 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.405808 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.405943 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.406172 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.406913 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.407175 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.407309 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.407484 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.407577 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.407816 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.407908 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.408133 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.408227 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.408444 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.408532 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.408752 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.408851 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.409067 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.409161 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.409376 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.409468 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.409686 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.409777 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.410027 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.410159 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.410348 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.410461 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.410665 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.410844 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.410976 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.411085 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.411289 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.411430 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.411600 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.411723 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.411908 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.412304 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.412484 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.412627 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.412795 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.412941 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.413100 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.413290 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.413411 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.413605 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.413706 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.413968 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.414077 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.414298 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.414398 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.414630 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.414729 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.414964 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.415064 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.415273 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.415372 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.415582 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.415685 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.415891 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.415998 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.416215 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.416321 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.416534 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.416625 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.416860 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.416958 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.417183 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.417285 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.417499 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.417598 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.417817 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.417952 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.418156 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.418257 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.418470 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.418562 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.418786 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.418880 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.419094 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.419200 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.419413 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.419656 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.419750 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.419992 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.420108 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.420318 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.420420 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.420624 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.420737 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.420943 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.421060 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.421253 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.421358 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.421567 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.421729 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.421979 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.422165 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.422314 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.422409 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.422634 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.422729 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.422940 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.423046 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.423253 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.423354 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.423573 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.423834 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.423938 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.424179 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.424281 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.424527 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.424657 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.424804 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.424992 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.425118 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.425316 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.425416 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.425642 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.425735 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.425988 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.426098 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.426353 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.426449 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.426662 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.426765 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.426976 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.427069 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.427284 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.427384 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.427603 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.427709 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.427912 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.428011 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.428221 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.428322 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.428532 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.428638 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.428839 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.428932 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.429153 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.429245 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.429458 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.429558 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.429771 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.429910 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.430114 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.430220 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.430526 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.430638 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.430832 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.430937 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.431143 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.431237 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.431460 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.431591 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.431780 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.431895 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.432094 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.432183 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.432401 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.432496 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.432820 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.432940 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.433133 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.433298 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.433451 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.433592 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.433765 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.433951 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.434096 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.434285 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.434387 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.434610 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.434711 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.434936 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.435029 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.435270 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.435373 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.435583 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.435684 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.435887 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.435980 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.436202 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.436310 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.436507 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.436600 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.436819 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.436923 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.437149 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.437244 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.437489 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.437584 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.437802 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.437936 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.438165 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.438259 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.438481 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.438581 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.438859 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.439027 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.439185 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.439392 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.439492 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.439725 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.439832 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.440062 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.440155 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.440397 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.440513 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.440706 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.440823 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.441023 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.441119 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.441345 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.441444 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.441659 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.441771 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.441997 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.442134 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.442306 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.442481 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.442629 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.442780 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.442923 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.443070 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.443245 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.443343 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.443569 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.443706 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.443915 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.444056 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.444232 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.444395 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.444546 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.444685 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.444849 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.444985 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.445182 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.445319 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.445494 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.445646 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.445788 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.445958 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.446121 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.446210 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.446427 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.446529 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.446733 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.446832 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.447041 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.447143 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.447348 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.447449 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.447654 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.447753 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.447961 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.448063 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.448269 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.448363 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.448574 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.448674 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.448882 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.448988 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.449198 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.449297 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.449500 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.449599 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.449810 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.449936 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.450150 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.450243 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.450474 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.450575 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.450796 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.450945 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.451106 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.451223 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.451427 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.451527 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.451738 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.451842 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.452041 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.452134 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.452348 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.452437 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.452654 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.452747 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.453616 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.453725 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.453957 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.454067 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.454361 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.454559 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.454698 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.454902 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.455033 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.455234 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.455352 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.455608 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.455737 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.455950 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.456058 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.456267 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.456372 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.456582 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.456694 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.456897 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.457008 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.457227 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.457330 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.457535 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.457640 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.457846 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.457969 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.458177 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.458288 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.458485 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.458588 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.458795 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.458907 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.459106 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.459216 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.459410 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.459512 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.459717 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.459830 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.460024 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.460134 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.460335 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.460437 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.460643 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.460754 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.460955 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.461056 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.461265 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.461370 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.461572 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.461686 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.461899 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.462007 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.462208 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.462325 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.462554 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.462680 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.462862 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.462974 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.463193 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.463287 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.463511 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.463630 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.463832 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.463947 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.464148 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.464252 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.464456 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.464551 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.464781 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.464883 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.465100 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.465220 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.465418 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.465532 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.465728 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.465821 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.466146 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.466251 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.466465 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.466561 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.466783 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.466882 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.467102 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.467215 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.467411 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.467506 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.467729 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.467833 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.468047 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.468151 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.468361 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.468455 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.469227 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.469546 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.469655 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.469927 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.470032 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.470248 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.470343 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.470587 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.470695 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.470921 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.471018 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.471237 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.471340 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.471547 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.471652 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.471860 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.471958 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.472177 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.472329 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.472495 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.472608 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.472811 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.472924 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.473123 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.473234 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.473432 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.473537 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.473748 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.473882 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.474084 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.474222 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.474399 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.474549 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.474711 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.474876 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.475020 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.475200 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.475335 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.475520 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.475644 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.475878 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.475983 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.476198 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.476295 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.476513 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.476615 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.476833 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.476935 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.477140 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.477235 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.477457 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.477552 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.477768 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.477919 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.478105 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.478200 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.478414 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.478510 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.478725 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.478833 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.479034 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.479130 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.479344 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.479446 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.479662 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.479771 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.479979 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.480074 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.480307 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.480401 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.480620 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.480723 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.480948 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.481044 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.481262 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.481408 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.481581 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.481677 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.481925 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.482154 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.482262 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.482447 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.482562 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.482769 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.482888 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.483110 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.483216 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.483441 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.483546 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.483770 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.483866 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.484114 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.484277 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.484530 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.484643 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.484810 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.484927 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.485101 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.485242 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.485435 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.485553 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.485750 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.485883 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.486109 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.486215 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.486436 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.486558 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.486769 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.486871 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.487091 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.487194 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.487403 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.487496 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.487728 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.487821 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.488041 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.488142 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.488356 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.488576 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.488679 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.488929 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.489023 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.489252 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.489347 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.489584 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.489686 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.489936 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.490043 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.490259 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.490361 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.490570 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.490672 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.490898 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.491003 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.491206 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.491321 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.491580 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.491671 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.491823 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.491927 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.492144 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.492315 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.492484 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.492630 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.492774 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.492926 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.493078 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.493273 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.493415 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.493558 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.493706 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.493954 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.494103 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.494288 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 12:25:50.494423 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.494590 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.494900 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.495209 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.495515 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.495827 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.496135 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.496443 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.496753 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.497058 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.497375 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.497683 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.498020 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.498332 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.498647 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.498956 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.499267 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.499619 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.499996 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.500304 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.500614 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.500934 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.501245 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.501570 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.501895 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.502217 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.502565 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.502886 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.503432 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.503769 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.504093 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.504430 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.504764 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.505075 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.505386 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.505693 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.506043 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.506359 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.506671 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.506986 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.507299 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.507613 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.507925 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.508237 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.508548 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.508860 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.509169 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.509481 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.509791 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.510148 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.510466 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.510809 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.511130 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.511448 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.511771 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.512091 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.512404 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.512718 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.513035 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.513349 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.513666 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.514021 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.514339 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.514646 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.515071 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.515385 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.516459 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.516789 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.517107 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.517436 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.517764 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.518112 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.518440 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.518757 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.519093 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.519439 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.519773 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.520104 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.520414 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.520723 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.521033 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.521346 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.521670 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.522008 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.522318 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.522626 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.522940 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.523246 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.523560 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.523868 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.524175 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.524485 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.524791 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.525095 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.525402 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.525710 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.526043 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.526352 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.526662 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.526969 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.527274 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.527580 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.527886 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.528191 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.528525 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.528861 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.529177 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.529501 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.529813 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.530165 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.530480 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.530806 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.531969 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.532499 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.533008 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.533351 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.533673 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.534018 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.534341 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.534661 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.534976 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.535308 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.535628 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.535956 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.536271 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.536602 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.536924 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.537516 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.537835 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.538176 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.538511 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.538826 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.539136 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.539454 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.539770 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.540084 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.540403 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.540724 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.541054 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.541383 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.541698 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.542058 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.542388 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.542739 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.543058 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.543403 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.543738 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.544057 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.544375 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.544737 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:25:50.544928 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 12:25:50.559143 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO dbcounter [None req-2268660c-29bf-4315-b98a-b400132923b5 None None] Registered counter for database nova_api Jun 16 12:25:50.580774 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_db.sqlalchemy.engines [None req-2268660c-29bf-4315-b98a-b400132923b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117606) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 12:25:50.587691 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writer thread running {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 12:25:50.608144 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO dbcounter [None req-b25e3e9f-2d51-48db-91f2-b72598f10739 None None] Registered counter for database nova_api Jun 16 12:25:50.627715 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_db.sqlalchemy.engines [None req-b25e3e9f-2d51-48db-91f2-b72598f10739 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117607) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 12:25:50.634445 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writer thread running {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 12:25:50.645313 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.context [None req-2268660c-29bf-4315-b98a-b400132923b5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),775f0c5f-83ba-4167-a2ea-1fd3bdd524cf(cell1) {{(pid=117606) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 12:25:50.649469 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2268660c-29bf-4315-b98a-b400132923b5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:25:50.651070 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2268660c-29bf-4315-b98a-b400132923b5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:25:50.651858 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2268660c-29bf-4315-b98a-b400132923b5 None None] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:25:50.653812 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2268660c-29bf-4315-b98a-b400132923b5 None None] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:25:50.655823 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO dbcounter [None req-2268660c-29bf-4315-b98a-b400132923b5 None None] Registered counter for database nova_cell0 Jun 16 12:25:50.660254 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO dbcounter [None req-2268660c-29bf-4315-b98a-b400132923b5 None None] Registered counter for database nova_cell1 Jun 16 12:25:50.668780 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_db.sqlalchemy.engines [None req-2268660c-29bf-4315-b98a-b400132923b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117606) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 12:25:50.670160 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_db.sqlalchemy.engines [None req-2268660c-29bf-4315-b98a-b400132923b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117606) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 12:25:50.676034 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writer thread running {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 12:25:50.677346 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writer thread running {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 12:25:50.692932 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.context [None req-b25e3e9f-2d51-48db-91f2-b72598f10739 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),775f0c5f-83ba-4167-a2ea-1fd3bdd524cf(cell1) {{(pid=117607) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 12:25:50.697091 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b25e3e9f-2d51-48db-91f2-b72598f10739 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:25:50.698682 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b25e3e9f-2d51-48db-91f2-b72598f10739 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:25:50.699503 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b25e3e9f-2d51-48db-91f2-b72598f10739 None None] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:25:50.701455 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b25e3e9f-2d51-48db-91f2-b72598f10739 None None] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:25:50.704001 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO dbcounter [None req-b25e3e9f-2d51-48db-91f2-b72598f10739 None None] Registered counter for database nova_cell0 Jun 16 12:25:50.707965 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO dbcounter [None req-b25e3e9f-2d51-48db-91f2-b72598f10739 None None] Registered counter for database nova_cell1 Jun 16 12:25:50.715036 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_db.sqlalchemy.engines [None req-b25e3e9f-2d51-48db-91f2-b72598f10739 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117607) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 12:25:50.716807 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_db.sqlalchemy.engines [None req-b25e3e9f-2d51-48db-91f2-b72598f10739 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117607) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 12:25:50.722737 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writer thread running {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 12:25:50.725201 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writer thread running {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 12:25:50.826210 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO dbcounter [None req-2268660c-29bf-4315-b98a-b400132923b5 None None] Registered counter for database nova_cell0 Jun 16 12:25:50.833333 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_db.sqlalchemy.engines [None req-2268660c-29bf-4315-b98a-b400132923b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117606) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 12:25:50.838348 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writer thread running {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 12:25:50.875456 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO dbcounter [None req-b25e3e9f-2d51-48db-91f2-b72598f10739 None None] Registered counter for database nova_cell0 Jun 16 12:25:50.882889 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_db.sqlalchemy.engines [None req-b25e3e9f-2d51-48db-91f2-b72598f10739 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117607) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 12:25:50.887849 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writer thread running {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 12:25:51.165697 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: WARNING keystonemiddleware.auth_token [None req-2268660c-29bf-4315-b98a-b400132923b5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 12:25:51.174239 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: WARNING keystonemiddleware.auth_token [None req-2268660c-29bf-4315-b98a-b400132923b5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 12:25:51.217901 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: WARNING keystonemiddleware.auth_token [None req-b25e3e9f-2d51-48db-91f2-b72598f10739 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 12:25:51.225391 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: WARNING keystonemiddleware.auth_token [None req-b25e3e9f-2d51-48db-91f2-b72598f10739 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 12:25:51.524892 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: WARNING keystonemiddleware.auth_token [None req-2268660c-29bf-4315-b98a-b400132923b5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 12:25:51.530878 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: WARNING keystonemiddleware.auth_token [None req-2268660c-29bf-4315-b98a-b400132923b5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 12:25:51.536275 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55664b4ab9c0 pid: 117606 (default app) Jun 16 12:25:51.571736 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: WARNING keystonemiddleware.auth_token [None req-b25e3e9f-2d51-48db-91f2-b72598f10739 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 12:25:51.577674 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: WARNING keystonemiddleware.auth_token [None req-b25e3e9f-2d51-48db-91f2-b72598f10739 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 12:25:51.583797 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55664b4ab9c0 pid: 117607 (default app) Jun 16 12:26:31.772678 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=3 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:26:31.773540 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=3 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:26:31.774655 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=3 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:26:31.775555 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=3 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:26:33.161483 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-142460aa-bc04-4683-bb12-28e6d4fe69c9 tempest-VolumesSnapshotsTestJSON-1630091441 tempest-VolumesSnapshotsTestJSON-1630091441-project] Action: 'create', calling method: .version_select at 0x7f7c74156820>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-203026088"}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:26:35.290563 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-142460aa-bc04-4683-bb12-28e6d4fe69c9 tempest-VolumesSnapshotsTestJSON-1630091441 tempest-VolumesSnapshotsTestJSON-1630091441-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.532179 Jun 16 12:26:35.291432 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1/1] 10.222.0.45 () {60 vars in 1154 bytes} [Thu Jun 16 12:26:31 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3535 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 16 12:26:35.642037 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ea212826-b2a7-4aae-bb1d-9362b0e80771 tempest-VolumesSnapshotsTestJSON-1630091441 tempest-VolumesSnapshotsTestJSON-1630091441-project] Calling method '.version_select at 0x7f7c74b609d0>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:26:35.681645 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=3 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:26:35.682789 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell0:SELECT=3 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:26:35.683773 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=3 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:26:35.685242 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell0:SELECT=3 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:26:36.226660 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ea212826-b2a7-4aae-bb1d-9362b0e80771 tempest-VolumesSnapshotsTestJSON-1630091441 tempest-VolumesSnapshotsTestJSON-1630091441-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/dd34099e-80dc-4342-b91c-55cd428140f8" status: 200 len: 344 microversion: 2.1 time: 0.925456 Jun 16 12:26:36.227502 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1/2] 10.222.0.45 () {58 vars in 1244 bytes} [Thu Jun 16 12:26:35 2022] GET /compute/v2.1/os-volumes/dd34099e-80dc-4342-b91c-55cd428140f8 => generated 344 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:26:37.240292 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-78a5973b-59c5-4d51-878f-bf79497a1bbd tempest-VolumesSnapshotsTestJSON-1630091441 tempest-VolumesSnapshotsTestJSON-1630091441-project] Calling method '.version_select at 0x7f7c74023670>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:26:37.316690 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-78a5973b-59c5-4d51-878f-bf79497a1bbd tempest-VolumesSnapshotsTestJSON-1630091441 tempest-VolumesSnapshotsTestJSON-1630091441-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/dd34099e-80dc-4342-b91c-55cd428140f8" status: 200 len: 345 microversion: 2.1 time: 0.080675 Jun 16 12:26:37.318307 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 2/3] 10.222.0.45 () {58 vars in 1244 bytes} [Thu Jun 16 12:26:37 2022] GET /compute/v2.1/os-volumes/dd34099e-80dc-4342-b91c-55cd428140f8 => generated 345 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:26:37.333359 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6b63a14b-e957-49d2-8b05-a599c21a135a tempest-VolumesSnapshotsTestJSON-1630091441 tempest-VolumesSnapshotsTestJSON-1630091441-project] Action: 'create', calling method: .version_select at 0x7f7c74064550>, body: {"snapshot": {"volume_id": "dd34099e-80dc-4342-b91c-55cd428140f8", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1764006548"}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:26:37.737033 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6b63a14b-e957-49d2-8b05-a599c21a135a tempest-VolumesSnapshotsTestJSON-1630091441 tempest-VolumesSnapshotsTestJSON-1630091441-project] 10.222.0.45 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.410733 Jun 16 12:26:37.737615 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 2/4] 10.222.0.45 () {60 vars in 1161 bytes} [Thu Jun 16 12:26:37 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:26:37.748737 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5b748225-e700-4026-bd2d-d304d2b91abf tempest-VolumesSnapshotsTestJSON-1630091441 tempest-VolumesSnapshotsTestJSON-1630091441-project] Calling method '.version_select at 0x7f7c74023790>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:26:37.796799 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5b748225-e700-4026-bd2d-d304d2b91abf tempest-VolumesSnapshotsTestJSON-1630091441 tempest-VolumesSnapshotsTestJSON-1630091441-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/e70b5f6b-73c7-466a-b655-644c93f5bb0d" status: 200 len: 287 microversion: 2.1 time: 0.052663 Jun 16 12:26:37.797605 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 3/5] 10.222.0.45 () {58 vars in 1250 bytes} [Thu Jun 16 12:26:37 2022] GET /compute/v2.1/os-snapshots/e70b5f6b-73c7-466a-b655-644c93f5bb0d => generated 287 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:26:37.809515 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-9ec828c2-d47b-420b-ab82-897cb45af8de tempest-VolumesSnapshotsTestJSON-1630091441 tempest-VolumesSnapshotsTestJSON-1630091441-project] Calling method '.version_select at 0x7f7c74064d30>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:26:37.883639 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-9ec828c2-d47b-420b-ab82-897cb45af8de tempest-VolumesSnapshotsTestJSON-1630091441 tempest-VolumesSnapshotsTestJSON-1630091441-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.078716 Jun 16 12:26:37.884221 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 3/6] 10.222.0.45 () {58 vars in 1139 bytes} [Thu Jun 16 12:26:37 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:26:37.896277 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c30e1215-c509-44c8-9e83-0fa0be2d5067 tempest-VolumesSnapshotsTestJSON-1630091441 tempest-VolumesSnapshotsTestJSON-1630091441-project] Calling method '.version_select at 0x7f7c74023e50>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:26:37.958037 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c30e1215-c509-44c8-9e83-0fa0be2d5067 tempest-VolumesSnapshotsTestJSON-1630091441 tempest-VolumesSnapshotsTestJSON-1630091441-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/e70b5f6b-73c7-466a-b655-644c93f5bb0d" status: 200 len: 287 microversion: 2.1 time: 0.065448 Jun 16 12:26:37.959217 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 4/7] 10.222.0.45 () {58 vars in 1250 bytes} [Thu Jun 16 12:26:37 2022] GET /compute/v2.1/os-snapshots/e70b5f6b-73c7-466a-b655-644c93f5bb0d => generated 287 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:26:38.970526 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1da7d54c-e869-415c-ae6f-91595b89bc03 tempest-VolumesSnapshotsTestJSON-1630091441 tempest-VolumesSnapshotsTestJSON-1630091441-project] Calling method '.version_select at 0x7f7c74025a60>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:26:39.057394 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1da7d54c-e869-415c-ae6f-91595b89bc03 tempest-VolumesSnapshotsTestJSON-1630091441 tempest-VolumesSnapshotsTestJSON-1630091441-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/e70b5f6b-73c7-466a-b655-644c93f5bb0d" status: 200 len: 287 microversion: 2.1 time: 0.090939 Jun 16 12:26:39.057994 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 4/8] 10.222.0.45 () {58 vars in 1250 bytes} [Thu Jun 16 12:26:38 2022] GET /compute/v2.1/os-snapshots/e70b5f6b-73c7-466a-b655-644c93f5bb0d => generated 287 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:26:40.068906 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9f488534-7f26-4922-856e-29b1b87957de tempest-VolumesSnapshotsTestJSON-1630091441 tempest-VolumesSnapshotsTestJSON-1630091441-project] Calling method '.version_select at 0x7f7c7403c550>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:26:40.119310 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9f488534-7f26-4922-856e-29b1b87957de tempest-VolumesSnapshotsTestJSON-1630091441 tempest-VolumesSnapshotsTestJSON-1630091441-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/e70b5f6b-73c7-466a-b655-644c93f5bb0d" status: 200 len: 287 microversion: 2.1 time: 0.054404 Jun 16 12:26:40.120303 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 5/9] 10.222.0.45 () {58 vars in 1250 bytes} [Thu Jun 16 12:26:40 2022] GET /compute/v2.1/os-snapshots/e70b5f6b-73c7-466a-b655-644c93f5bb0d => generated 287 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:26:41.131854 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4e174da7-1be2-4728-af5a-fc1837e35ca6 tempest-VolumesSnapshotsTestJSON-1630091441 tempest-VolumesSnapshotsTestJSON-1630091441-project] Calling method '.version_select at 0x7f7c740258b0>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:26:41.184697 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4e174da7-1be2-4728-af5a-fc1837e35ca6 tempest-VolumesSnapshotsTestJSON-1630091441 tempest-VolumesSnapshotsTestJSON-1630091441-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/e70b5f6b-73c7-466a-b655-644c93f5bb0d" status: 200 len: 287 microversion: 2.1 time: 0.056648 Jun 16 12:26:41.189453 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 5/10] 10.222.0.45 () {58 vars in 1250 bytes} [Thu Jun 16 12:26:41 2022] GET /compute/v2.1/os-snapshots/e70b5f6b-73c7-466a-b655-644c93f5bb0d => generated 287 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:26:42.198516 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8f420f9a-b385-48c6-9042-f43e3685d8ee tempest-VolumesSnapshotsTestJSON-1630091441 tempest-VolumesSnapshotsTestJSON-1630091441-project] Calling method '.version_select at 0x7f7c74023d30>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:26:42.282168 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8f420f9a-b385-48c6-9042-f43e3685d8ee tempest-VolumesSnapshotsTestJSON-1630091441 tempest-VolumesSnapshotsTestJSON-1630091441-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/e70b5f6b-73c7-466a-b655-644c93f5bb0d" status: 200 len: 287 microversion: 2.1 time: 0.088689 Jun 16 12:26:42.283449 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 6/11] 10.222.0.45 () {58 vars in 1250 bytes} [Thu Jun 16 12:26:42 2022] GET /compute/v2.1/os-snapshots/e70b5f6b-73c7-466a-b655-644c93f5bb0d => generated 287 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:26:43.295550 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8a98b401-aede-4d86-a7d9-7a192cc036ed tempest-VolumesSnapshotsTestJSON-1630091441 tempest-VolumesSnapshotsTestJSON-1630091441-project] Calling method '.version_select at 0x7f7c74025040>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:26:43.363972 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8a98b401-aede-4d86-a7d9-7a192cc036ed tempest-VolumesSnapshotsTestJSON-1630091441 tempest-VolumesSnapshotsTestJSON-1630091441-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/e70b5f6b-73c7-466a-b655-644c93f5bb0d" status: 200 len: 287 microversion: 2.1 time: 0.073011 Jun 16 12:26:43.364796 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 6/12] 10.222.0.45 () {58 vars in 1250 bytes} [Thu Jun 16 12:26:43 2022] GET /compute/v2.1/os-snapshots/e70b5f6b-73c7-466a-b655-644c93f5bb0d => generated 287 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:26:44.376735 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d8f8b707-c82b-45ca-87ca-68f0c60ad18d tempest-VolumesSnapshotsTestJSON-1630091441 tempest-VolumesSnapshotsTestJSON-1630091441-project] Calling method '.version_select at 0x7f7c74023940>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:26:44.455375 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d8f8b707-c82b-45ca-87ca-68f0c60ad18d tempest-VolumesSnapshotsTestJSON-1630091441 tempest-VolumesSnapshotsTestJSON-1630091441-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/e70b5f6b-73c7-466a-b655-644c93f5bb0d" status: 200 len: 288 microversion: 2.1 time: 0.083305 Jun 16 12:26:44.456376 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 7/13] 10.222.0.45 () {58 vars in 1250 bytes} [Thu Jun 16 12:26:44 2022] GET /compute/v2.1/os-snapshots/e70b5f6b-73c7-466a-b655-644c93f5bb0d => generated 288 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:26:44.469582 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b7b14d43-6f1b-4aa4-ba3f-2282e7c0efd9 tempest-VolumesSnapshotsTestJSON-1630091441 tempest-VolumesSnapshotsTestJSON-1630091441-project] Calling method '.version_select at 0x7f7c74064ee0>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:26:44.645167 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b7b14d43-6f1b-4aa4-ba3f-2282e7c0efd9 tempest-VolumesSnapshotsTestJSON-1630091441 tempest-VolumesSnapshotsTestJSON-1630091441-project] 10.222.0.45 "DELETE /compute/v2.1/os-snapshots/e70b5f6b-73c7-466a-b655-644c93f5bb0d" status: 202 len: 0 microversion: 2.1 time: 0.183000 Jun 16 12:26:44.646358 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 7/14] 10.222.0.45 () {58 vars in 1253 bytes} [Thu Jun 16 12:26:44 2022] DELETE /compute/v2.1/os-snapshots/e70b5f6b-73c7-466a-b655-644c93f5bb0d => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 12:26:44.655616 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e55bf3f5-d493-4db8-b201-6a36d2cecdfe tempest-VolumesSnapshotsTestJSON-1630091441 tempest-VolumesSnapshotsTestJSON-1630091441-project] Calling method '.version_select at 0x7f7c7403c700>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:26:44.733481 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e55bf3f5-d493-4db8-b201-6a36d2cecdfe tempest-VolumesSnapshotsTestJSON-1630091441 tempest-VolumesSnapshotsTestJSON-1630091441-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/e70b5f6b-73c7-466a-b655-644c93f5bb0d" status: 200 len: 287 microversion: 2.1 time: 0.082784 Jun 16 12:26:44.734180 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 8/15] 10.222.0.45 () {58 vars in 1250 bytes} [Thu Jun 16 12:26:44 2022] GET /compute/v2.1/os-snapshots/e70b5f6b-73c7-466a-b655-644c93f5bb0d => generated 287 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:26:44.796566 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3e148c56-28aa-4849-94be-35f10b7e9bc0 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-120395500", "imageRef": "c736a2d2-9d0d-41ec-b9fc-971428b0ff7a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:26:45.043307 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.network.neutron [None req-3e148c56-28aa-4849-94be-35f10b7e9bc0 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] validate_networks() for [('15343ced-c8e8-4ebc-8e76-3a9958a1ff36', None, None, None, None, None)] {{(pid=117607) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 12:26:45.346319 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-10f5330c-0c77-422e-9b9b-d03f459f9cd9 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Action: 'create', calling method: .version_select at 0x7f7c7403cb80>, body: {"keypair": {"name": "tempest-keypair-309975216", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7ui03CP2NvbC60jwvuA6brWKa6ZeEWSLkz/ivVzbvDWbAAFvR+ox3r81A6WztroPOWWq12Fj9S/N19KrEXM/6SRp/QUb566yWlwZ+HJaW9Iyyyr0xqnSUoJHA9B9j67Q=="}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:26:45.445808 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-10f5330c-0c77-422e-9b9b-d03f459f9cd9 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Getting quotas for project 3fce886a9a894240a0b3bd3af94d2465. Resources: {'key_pairs'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 12:26:45.459546 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-10f5330c-0c77-422e-9b9b-d03f459f9cd9 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Getting quotas for user ed6b630c60d640afb1325215ea27acef and project 3fce886a9a894240a0b3bd3af94d2465. Resources: {'key_pairs'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 12:26:45.574039 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-10f5330c-0c77-422e-9b9b-d03f459f9cd9 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.300486 Jun 16 12:26:45.575431 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 9/16] 10.222.0.45 () {60 vars in 1158 bytes} [Thu Jun 16 12:26:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:26:45.789947 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a5e8aa58-2db9-4875-8ceb-94391b864371 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Action: 'create', calling method: .version_select at 0x7f7c73f955e0>, body: {"keypair": {"name": "tempest-keypair-1163063130", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIGrNUXYTnneocKRuKARAKGDyPffFOVjtx+jCzy0wkI0dmvzs2QIvHwwQnUKaoM2fDDdk15t5uu+HmiUz2oJLN1hDSs32aHdySnBz/VGOohwPi2VyVOBfzbL3dAZl3XEcA=="}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:26:45.823719 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-a5e8aa58-2db9-4875-8ceb-94391b864371 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Getting quotas for project 501ea87534094acaa1b0a50b01901cac. Resources: {'key_pairs'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 12:26:45.835783 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-a5e8aa58-2db9-4875-8ceb-94391b864371 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Getting quotas for user cb370edc0f094c04904eb093a9eb0a42 and project 501ea87534094acaa1b0a50b01901cac. Resources: {'key_pairs'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 12:26:45.903643 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a5e8aa58-2db9-4875-8ceb-94391b864371 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.221355 Jun 16 12:26:45.924814 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 10/17] 10.222.0.45 () {62 vars in 1199 bytes} [Thu Jun 16 12:26:45 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 242 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 16 12:26:45.962737 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-23ab9baa-f7e7-4bfe-8fac-b811e4805539 tempest-VolumesSnapshotsTestJSON-1630091441 tempest-VolumesSnapshotsTestJSON-1630091441-project] Calling method '.version_select at 0x7f7c73fcab80>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:26:46.041190 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-23ab9baa-f7e7-4bfe-8fac-b811e4805539 tempest-VolumesSnapshotsTestJSON-1630091441 tempest-VolumesSnapshotsTestJSON-1630091441-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/e70b5f6b-73c7-466a-b655-644c93f5bb0d" status: 200 len: 287 microversion: 2.1 time: 0.113764 Jun 16 12:26:46.042974 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 11/18] 10.222.0.45 () {58 vars in 1250 bytes} [Thu Jun 16 12:26:45 2022] GET /compute/v2.1/os-snapshots/e70b5f6b-73c7-466a-b655-644c93f5bb0d => generated 287 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:26:46.355996 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-3e148c56-28aa-4849-94be-35f10b7e9bc0 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Flavor limits 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 12:26:46.357079 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-3e148c56-28aa-4849-94be-35f10b7e9bc0 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Image limits 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 12:26:46.358076 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-3e148c56-28aa-4849-94be-35f10b7e9bc0 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Flavor pref 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 12:26:46.358812 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-3e148c56-28aa-4849-94be-35f10b7e9bc0 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Image pref 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 12:26:46.359451 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-3e148c56-28aa-4849-94be-35f10b7e9bc0 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 12:26:46.411277 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3e148c56-28aa-4849-94be-35f10b7e9bc0 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:26:46.411984 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3e148c56-28aa-4849-94be-35f10b7e9bc0 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:26:46.416417 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3e148c56-28aa-4849-94be-35f10b7e9bc0 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:26:46.417016 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3e148c56-28aa-4849-94be-35f10b7e9bc0 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:26:46.532776 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-3e148c56-28aa-4849-94be-35f10b7e9bc0 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Getting quotas for project 338412f496e246eebc934f348c539335. Resources: {'instances', 'cores', 'ram'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 12:26:46.548177 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-3e148c56-28aa-4849-94be-35f10b7e9bc0 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Getting quotas for user a333ad2fb1c74ef9a666aa591616d7a2 and project 338412f496e246eebc934f348c539335. Resources: {'instances', 'cores', 'ram'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 12:26:46.587679 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3e148c56-28aa-4849-94be-35f10b7e9bc0 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Going to run 1 instances... {{(pid=117607) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 12:26:46.596084 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3e148c56-28aa-4849-94be-35f10b7e9bc0 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c7405152-1807-4b2a-8701-ef2b2a8cbafb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c736a2d2-9d0d-41ec-b9fc-971428b0ff7a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117607) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 12:26:46.812383 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3e148c56-28aa-4849-94be-35f10b7e9bc0 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.142709 Jun 16 12:26:46.817129 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 8/19] 10.222.0.45 () {60 vars in 1146 bytes} [Thu Jun 16 12:26:44 2022] POST /compute/v2.1/servers => generated 383 bytes in 2155 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 12:26:46.830617 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ab42c075-a694-42b4-9f2c-7a145884bf81 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:26:46.832937 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ab42c075-a694-42b4-9f2c-7a145884bf81 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c7405152-1807-4b2a-8701-ef2b2a8cbafb] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:26:47.039598 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ab42c075-a694-42b4-9f2c-7a145884bf81 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:26:47.061098 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-69682df9-dcfd-463a-bde2-398438eedd47 tempest-VolumesSnapshotsTestJSON-1630091441 tempest-VolumesSnapshotsTestJSON-1630091441-project] Calling method '.version_select at 0x7f7c73f451f0>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:26:47.069475 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ab42c075-a694-42b4-9f2c-7a145884bf81 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb" status: 200 len: 1221 microversion: 2.1 time: 0.245320 Jun 16 12:26:47.070933 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 12/20] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:26:46 2022] GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb => generated 1221 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:26:47.121820 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-69682df9-dcfd-463a-bde2-398438eedd47 tempest-VolumesSnapshotsTestJSON-1630091441 tempest-VolumesSnapshotsTestJSON-1630091441-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/e70b5f6b-73c7-466a-b655-644c93f5bb0d" status: 200 len: 287 microversion: 2.1 time: 0.071191 Jun 16 12:26:47.123804 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 9/21] 10.222.0.45 () {58 vars in 1250 bytes} [Thu Jun 16 12:26:47 2022] GET /compute/v2.1/os-snapshots/e70b5f6b-73c7-466a-b655-644c93f5bb0d => generated 287 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:26:47.181938 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-58a7dc13-2cce-4112-b7db-16327a05444c tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-376110852", "imageRef": "c736a2d2-9d0d-41ec-b9fc-971428b0ff7a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:26:47.418262 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.network.neutron [None req-58a7dc13-2cce-4112-b7db-16327a05444c tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] validate_networks() for [('15343ced-c8e8-4ebc-8e76-3a9958a1ff36', None, None, None, None, None)] {{(pid=117606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 12:26:47.683737 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e5401475-989d-47e2-a625-9898072e7617 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2021769393", "imageRef": "c736a2d2-9d0d-41ec-b9fc-971428b0ff7a", "flavorRef": "452", "networks": [{"uuid": "c4f9af5b-d9c2-4287-b423-2240bca9fced"}]}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:26:47.828048 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.network.neutron [None req-e5401475-989d-47e2-a625-9898072e7617 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] validate_networks() for [('c4f9af5b-d9c2-4287-b423-2240bca9fced', None, None, None, None, None)] {{(pid=117607) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 12:26:49.531898 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-e5401475-989d-47e2-a625-9898072e7617 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Flavor limits 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 12:26:49.532520 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-e5401475-989d-47e2-a625-9898072e7617 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Image limits 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 12:26:49.532953 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-e5401475-989d-47e2-a625-9898072e7617 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Flavor pref 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 12:26:49.533382 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-e5401475-989d-47e2-a625-9898072e7617 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Image pref 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 12:26:49.533863 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-e5401475-989d-47e2-a625-9898072e7617 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 12:26:49.547497 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e5401475-989d-47e2-a625-9898072e7617 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:26:49.548818 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e5401475-989d-47e2-a625-9898072e7617 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:26:49.550906 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e5401475-989d-47e2-a625-9898072e7617 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:26:49.552082 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e5401475-989d-47e2-a625-9898072e7617 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:26:49.578882 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-e5401475-989d-47e2-a625-9898072e7617 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Getting quotas for project a66000602298490b9e76d8138fdb825b. Resources: {'instances', 'cores', 'ram'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 12:26:49.584395 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-e5401475-989d-47e2-a625-9898072e7617 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Getting quotas for user cf22beda54e24b878e514304e7a62b65 and project a66000602298490b9e76d8138fdb825b. Resources: {'instances', 'cores', 'ram'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 12:26:49.602444 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e5401475-989d-47e2-a625-9898072e7617 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Going to run 1 instances... {{(pid=117607) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 12:26:49.605374 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e5401475-989d-47e2-a625-9898072e7617 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] [instance: c72b39de-9695-4833-8a7a-76af4eaa33d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c736a2d2-9d0d-41ec-b9fc-971428b0ff7a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117607) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 12:26:49.664492 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-58a7dc13-2cce-4112-b7db-16327a05444c tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Flavor limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 12:26:49.664993 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-58a7dc13-2cce-4112-b7db-16327a05444c tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Image limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 12:26:49.665961 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-58a7dc13-2cce-4112-b7db-16327a05444c tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Flavor pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 12:26:49.666897 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-58a7dc13-2cce-4112-b7db-16327a05444c tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Image pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 12:26:49.667545 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-58a7dc13-2cce-4112-b7db-16327a05444c tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 12:26:49.679935 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-58a7dc13-2cce-4112-b7db-16327a05444c tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:26:49.681024 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-58a7dc13-2cce-4112-b7db-16327a05444c tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:26:49.689559 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-58a7dc13-2cce-4112-b7db-16327a05444c tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:26:49.691108 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-58a7dc13-2cce-4112-b7db-16327a05444c tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:26:49.730485 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e5401475-989d-47e2-a625-9898072e7617 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.146065 Jun 16 12:26:49.736750 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 10/22] 10.222.0.45 () {60 vars in 1146 bytes} [Thu Jun 16 12:26:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 2153 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 12:26:49.743897 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-58a7dc13-2cce-4112-b7db-16327a05444c tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Getting quotas for project 338412f496e246eebc934f348c539335. Resources: {'instances', 'cores', 'ram'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 12:26:49.747048 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1ecd19a8-a588-4d41-8eee-57f17449317f tempest-VolumesSnapshotsTestJSON-1630091441 tempest-VolumesSnapshotsTestJSON-1630091441-project] Calling method '.version_select at 0x7f7c73f32ca0>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:26:49.757269 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-58a7dc13-2cce-4112-b7db-16327a05444c tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Getting quotas for user a333ad2fb1c74ef9a666aa591616d7a2 and project 338412f496e246eebc934f348c539335. Resources: {'instances', 'cores', 'ram'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 12:26:49.804556 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-1ecd19a8-a588-4d41-8eee-57f17449317f tempest-VolumesSnapshotsTestJSON-1630091441 tempest-VolumesSnapshotsTestJSON-1630091441-project] HTTP exception thrown: Snapshot e70b5f6b-73c7-466a-b655-644c93f5bb0d could not be found. Jun 16 12:26:49.809593 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1ecd19a8-a588-4d41-8eee-57f17449317f tempest-VolumesSnapshotsTestJSON-1630091441 tempest-VolumesSnapshotsTestJSON-1630091441-project] Request method failure captured: Jun 16 12:26:49.809593 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: request: GET /compute/v2.1/os-snapshots/e70b5f6b-73c7-466a-b655-644c93f5bb0d HTTP/1.1 Jun 16 12:26:49.809593 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Accept: application/json Jun 16 12:26:49.809593 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jun 16 12:26:49.809593 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Connection: close Jun 16 12:26:49.809593 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jun 16 12:26:49.809593 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jun 16 12:26:49.809593 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Host: 10.222.0.45 Jun 16 12:26:49.809593 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jun 16 12:26:49.809593 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jun 16 12:26:49.809593 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABiqyF3G1BnBa5x-EdGKx8Gl50Bt4uRuzDsF9aXZnGfjBexzQTrNo-q1YTC2C-bEiN5vlHdGuifT_XmSIZAQexrpbog7UAcTU9N4GXFbF8V1K9hc07vv-pfZ6W6QSHFbo2YnTUX4sxX6kQEgSRSoQYTqZZc9oy4Sq-z6Z3CabeKHy26o0U Jun 16 12:26:49.809593 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jun 16 12:26:49.809593 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jun 16 12:26:49.809593 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jun 16 12:26:49.809593 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jun 16 12:26:49.809593 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jun 16 12:26:49.809593 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jun 16 12:26:49.809593 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Id: c07177c1805343e0a1001b9684c1b0d6 Jun 16 12:26:49.809593 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1630091441 Jun 16 12:26:49.809593 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Role: member,reader Jun 16 12:26:49.809593 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Roles: member,reader Jun 16 12:26:49.811541 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c07177c1805343e0a1001b9684c1b0d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c07177c1805343e0a1001b9684c1b0d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c07177c1805343e0a1001b9684c1b0d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c07177c1805343e0a1001b9684c1b0d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Jun 16 12:26:49.811541 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1630091441 Jun 16 12:26:49.811541 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant-Id: c07177c1805343e0a1001b9684c1b0d6 Jun 16 12:26:49.811541 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1630091441 Jun 16 12:26:49.811541 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User: tempest-VolumesSnapshotsTestJSON-1630091441-project Jun 16 12:26:49.811541 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jun 16 12:26:49.811541 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jun 16 12:26:49.811541 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Id: 4764071f84f247e69197a69b03b76006 Jun 16 12:26:49.811541 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1630091441-project Jun 16 12:26:49.811541 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: method: Jun 16 12:26:49.811541 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: exception: Snapshot e70b5f6b-73c7-466a-b655-644c93f5bb0d could not be found. Jun 16 12:26:49.811541 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: action_args: {'id': 'e70b5f6b-73c7-466a-b655-644c93f5bb0d'} Jun 16 12:26:49.811541 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:26:49.812401 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:26:49.812401 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 16 12:26:49.812401 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 16 12:26:49.812401 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 16 12:26:49.812401 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 16 12:26:49.812401 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 16 12:26:49.812401 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 16 12:26:49.812401 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 12:26:49.812401 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 12:26:49.812401 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 12:26:49.812401 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 12:26:49.812401 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 12:26:49.812401 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 12:26:49.812401 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 12:26:49.812401 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 12:26:49.812401 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot e70b5f6b-73c7-466a-b655-644c93f5bb0d could not be found. (HTTP 404) (Request-ID: req-114fee39-ba9f-4ffa-984e-3df45d215126) Jun 16 12:26:49.812401 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:26:49.812401 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:26:49.813317 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:26:49.813317 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:26:49.813317 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 16 12:26:49.813317 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 16 12:26:49.813317 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 12:26:49.813317 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 12:26:49.813317 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 16 12:26:49.813317 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 16 12:26:49.813317 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 12:26:49.813317 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 12:26:49.813317 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 16 12:26:49.813317 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 16 12:26:49.813317 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 16 12:26:49.813317 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 16 12:26:49.813317 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 16 12:26:49.813317 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 16 12:26:49.813317 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 12:26:49.813317 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 12:26:49.813317 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 12:26:49.815743 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 12:26:49.815743 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 12:26:49.815743 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 12:26:49.815743 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 12:26:49.815743 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 12:26:49.815743 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot e70b5f6b-73c7-466a-b655-644c93f5bb0d could not be found. Jun 16 12:26:49.815743 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:26:49.815743 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:26:49.815743 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:26:49.815743 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:26:49.815743 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:26:49.815743 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:26:49.815743 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:26:49.815743 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:26:49.815743 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 12:26:49.815743 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 12:26:49.815743 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:26:49.815743 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:26:49.815743 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 16 12:26:49.815743 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:26:49.818079 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot e70b5f6b-73c7-466a-b655-644c93f5bb0d could not be found. Jun 16 12:26:49.818079 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:26:49.818079 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:26:49.818079 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:26:49.818079 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:26:49.818079 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:26:49.818079 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:26:49.818079 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:26:49.818079 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:26:49.818079 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot e70b5f6b-73c7-466a-b655-644c93f5bb0d could not be found. Jun 16 12:26:49.818079 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:26:49.820699 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-58a7dc13-2cce-4112-b7db-16327a05444c tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Going to run 1 instances... {{(pid=117606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 12:26:49.821234 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1ecd19a8-a588-4d41-8eee-57f17449317f tempest-VolumesSnapshotsTestJSON-1630091441 tempest-VolumesSnapshotsTestJSON-1630091441-project] Returning 404 to user: Snapshot e70b5f6b-73c7-466a-b655-644c93f5bb0d could not be found. {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:26:49.822338 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1ecd19a8-a588-4d41-8eee-57f17449317f tempest-VolumesSnapshotsTestJSON-1630091441 tempest-VolumesSnapshotsTestJSON-1630091441-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/e70b5f6b-73c7-466a-b655-644c93f5bb0d" status: 404 len: 111 microversion: 2.1 time: 0.084397 Jun 16 12:26:49.823126 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 11/23] 10.222.0.45 () {58 vars in 1250 bytes} [Thu Jun 16 12:26:49 2022] GET /compute/v2.1/os-snapshots/e70b5f6b-73c7-466a-b655-644c93f5bb0d => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 12:26:49.834235 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-58a7dc13-2cce-4112-b7db-16327a05444c tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: 331b2de0-3963-4186-bc19-f2fe2e97d860] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c736a2d2-9d0d-41ec-b9fc-971428b0ff7a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 12:26:49.835905 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f01be5e4-b225-4094-8bb8-d4d652c46c35 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:26:49.836755 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f01be5e4-b225-4094-8bb8-d4d652c46c35 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] [instance: c72b39de-9695-4833-8a7a-76af4eaa33d4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:26:50.048379 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-58a7dc13-2cce-4112-b7db-16327a05444c tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.871465 Jun 16 12:26:50.049291 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 13/24] 10.222.0.45 () {60 vars in 1146 bytes} [Thu Jun 16 12:26:47 2022] POST /compute/v2.1/servers => generated 383 bytes in 2873 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 12:26:50.070063 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-cf9096b5-a002-4151-b6d1-fbaac442c4df tempest-VolumesSnapshotsTestJSON-1630091441 tempest-VolumesSnapshotsTestJSON-1630091441-project] Calling method '.version_select at 0x7f7c73695ca0>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:26:50.191603 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f01be5e4-b225-4094-8bb8-d4d652c46c35 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf22beda54e24b878e514304e7a62b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66000602298490b9e76d8138fdb825b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:26:50.237692 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f01be5e4-b225-4094-8bb8-d4d652c46c35 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] 10.222.0.45 "GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4" status: 200 len: 1215 microversion: 2.1 time: 0.408056 Jun 16 12:26:50.245816 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 12/25] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:26:49 2022] GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4 => generated 1215 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:26:50.275204 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-37c6fe24-365e-451c-babd-ea585e3b3ae6 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:26:50.286935 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-37c6fe24-365e-451c-babd-ea585e3b3ae6 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: 331b2de0-3963-4186-bc19-f2fe2e97d860] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:26:50.458179 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-cf9096b5-a002-4151-b6d1-fbaac442c4df tempest-VolumesSnapshotsTestJSON-1630091441 tempest-VolumesSnapshotsTestJSON-1630091441-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/dd34099e-80dc-4342-b91c-55cd428140f8" status: 202 len: 0 microversion: 2.1 time: 0.407569 Jun 16 12:26:50.458755 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 14/26] 10.222.0.45 () {58 vars in 1247 bytes} [Thu Jun 16 12:26:50 2022] DELETE /compute/v2.1/os-volumes/dd34099e-80dc-4342-b91c-55cd428140f8 => generated 0 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 12:26:50.467559 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5a98e689-ca1f-4a0e-b114-7ae737abd9ae tempest-VolumesSnapshotsTestJSON-1630091441 tempest-VolumesSnapshotsTestJSON-1630091441-project] Calling method '.version_select at 0x7f7c736aa310>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:26:50.693464 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5a98e689-ca1f-4a0e-b114-7ae737abd9ae tempest-VolumesSnapshotsTestJSON-1630091441 tempest-VolumesSnapshotsTestJSON-1630091441-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/dd34099e-80dc-4342-b91c-55cd428140f8" status: 200 len: 344 microversion: 2.1 time: 0.230543 Jun 16 12:26:50.694105 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 15/27] 10.222.0.45 () {58 vars in 1244 bytes} [Thu Jun 16 12:26:50 2022] GET /compute/v2.1/os-volumes/dd34099e-80dc-4342-b91c-55cd428140f8 => generated 344 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 12:26:50.791123 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-37c6fe24-365e-451c-babd-ea585e3b3ae6 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:26:50.805257 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-37c6fe24-365e-451c-babd-ea585e3b3ae6 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860" status: 200 len: 1221 microversion: 2.1 time: 0.544270 Jun 16 12:26:50.807371 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 13/28] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:26:50 2022] GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860 => generated 1221 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:26:51.154644 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ddfc612b-ab23-489b-b22f-d976aabb1173 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-733108862", "imageRef": "c736a2d2-9d0d-41ec-b9fc-971428b0ff7a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "151a2bee-6229-46e8-95f9-7544fde552a8"}], "security_groups": [{"name": "tempest-securitygroup--957202256"}], "key_name": "tempest-keypair-309975216", "user_data": "}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:26:51.267619 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-63a781da-1da2-49c7-a2f5-99f165c17936 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:26:51.268435 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-63a781da-1da2-49c7-a2f5-99f165c17936 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] [instance: c72b39de-9695-4833-8a7a-76af4eaa33d4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:26:51.828855 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-63a781da-1da2-49c7-a2f5-99f165c17936 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf22beda54e24b878e514304e7a62b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66000602298490b9e76d8138fdb825b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:26:51.847207 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-63a781da-1da2-49c7-a2f5-99f165c17936 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] 10.222.0.45 "GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4" status: 200 len: 1215 microversion: 2.1 time: 0.580974 Jun 16 12:26:51.850649 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 14/29] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:26:51 2022] GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4 => generated 1215 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:26:51.868619 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2278315e-1dc1-46de-9b82-726b2a93d702 tempest-VolumesSnapshotsTestJSON-1630091441 tempest-VolumesSnapshotsTestJSON-1630091441-project] Calling method '.version_select at 0x7f7c72e5c280>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:26:52.003590 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-2278315e-1dc1-46de-9b82-726b2a93d702 tempest-VolumesSnapshotsTestJSON-1630091441 tempest-VolumesSnapshotsTestJSON-1630091441-project] HTTP exception thrown: Volume dd34099e-80dc-4342-b91c-55cd428140f8 could not be found. Jun 16 12:26:52.006705 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2278315e-1dc1-46de-9b82-726b2a93d702 tempest-VolumesSnapshotsTestJSON-1630091441 tempest-VolumesSnapshotsTestJSON-1630091441-project] Request method failure captured: Jun 16 12:26:52.006705 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: request: GET /compute/v2.1/os-volumes/dd34099e-80dc-4342-b91c-55cd428140f8 HTTP/1.1 Jun 16 12:26:52.006705 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Accept: application/json Jun 16 12:26:52.006705 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jun 16 12:26:52.006705 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Connection: close Jun 16 12:26:52.006705 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jun 16 12:26:52.006705 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jun 16 12:26:52.006705 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Host: 10.222.0.45 Jun 16 12:26:52.006705 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jun 16 12:26:52.006705 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jun 16 12:26:52.006705 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABiqyF3G1BnBa5x-EdGKx8Gl50Bt4uRuzDsF9aXZnGfjBexzQTrNo-q1YTC2C-bEiN5vlHdGuifT_XmSIZAQexrpbog7UAcTU9N4GXFbF8V1K9hc07vv-pfZ6W6QSHFbo2YnTUX4sxX6kQEgSRSoQYTqZZc9oy4Sq-z6Z3CabeKHy26o0U Jun 16 12:26:52.006705 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jun 16 12:26:52.006705 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jun 16 12:26:52.006705 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jun 16 12:26:52.006705 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jun 16 12:26:52.006705 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jun 16 12:26:52.006705 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jun 16 12:26:52.006705 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Id: c07177c1805343e0a1001b9684c1b0d6 Jun 16 12:26:52.006705 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1630091441 Jun 16 12:26:52.006705 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Role: member,reader Jun 16 12:26:52.006705 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Roles: member,reader Jun 16 12:26:52.008123 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c07177c1805343e0a1001b9684c1b0d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c07177c1805343e0a1001b9684c1b0d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c07177c1805343e0a1001b9684c1b0d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c07177c1805343e0a1001b9684c1b0d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Jun 16 12:26:52.008123 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1630091441 Jun 16 12:26:52.008123 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant-Id: c07177c1805343e0a1001b9684c1b0d6 Jun 16 12:26:52.008123 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1630091441 Jun 16 12:26:52.008123 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User: tempest-VolumesSnapshotsTestJSON-1630091441-project Jun 16 12:26:52.008123 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jun 16 12:26:52.008123 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jun 16 12:26:52.008123 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Id: 4764071f84f247e69197a69b03b76006 Jun 16 12:26:52.008123 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1630091441-project Jun 16 12:26:52.008123 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: method: Jun 16 12:26:52.008123 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: exception: Volume dd34099e-80dc-4342-b91c-55cd428140f8 could not be found. Jun 16 12:26:52.008123 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: action_args: {'id': 'dd34099e-80dc-4342-b91c-55cd428140f8'} Jun 16 12:26:52.008123 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:26:52.008972 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:26:52.008972 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 12:26:52.008972 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 12:26:52.008972 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 12:26:52.008972 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 12:26:52.008972 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 12:26:52.008972 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 12:26:52.008972 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 12:26:52.008972 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 12:26:52.008972 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 12:26:52.008972 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 12:26:52.008972 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 12:26:52.008972 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 12:26:52.008972 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 12:26:52.008972 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 12:26:52.008972 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume dd34099e-80dc-4342-b91c-55cd428140f8 could not be found. (HTTP 404) (Request-ID: req-0d7c788c-cf74-4cfb-8a3f-87669002973b) Jun 16 12:26:52.008972 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:26:52.008972 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:26:52.008972 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:26:52.010156 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:26:52.010156 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 12:26:52.010156 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 12:26:52.010156 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 12:26:52.010156 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 12:26:52.010156 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 12:26:52.010156 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 12:26:52.010156 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 12:26:52.010156 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 12:26:52.010156 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 12:26:52.010156 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 12:26:52.010156 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 12:26:52.010156 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 12:26:52.010156 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 12:26:52.010156 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 12:26:52.010156 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 12:26:52.010156 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 12:26:52.010156 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 12:26:52.010156 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 12:26:52.011260 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 12:26:52.011260 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 12:26:52.011260 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 12:26:52.011260 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 12:26:52.011260 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume dd34099e-80dc-4342-b91c-55cd428140f8 could not be found. Jun 16 12:26:52.011260 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:26:52.011260 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:26:52.011260 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:26:52.011260 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:26:52.011260 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:26:52.011260 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:26:52.011260 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:26:52.011260 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:26:52.011260 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 12:26:52.011260 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 12:26:52.011260 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:26:52.011260 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:26:52.011260 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 12:26:52.011260 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:26:52.013886 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume dd34099e-80dc-4342-b91c-55cd428140f8 could not be found. Jun 16 12:26:52.013886 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:26:52.013886 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:26:52.013886 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:26:52.013886 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:26:52.013886 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:26:52.013886 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:26:52.013886 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:26:52.013886 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:26:52.013886 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume dd34099e-80dc-4342-b91c-55cd428140f8 could not be found. Jun 16 12:26:52.013886 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:26:52.013886 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2278315e-1dc1-46de-9b82-726b2a93d702 tempest-VolumesSnapshotsTestJSON-1630091441 tempest-VolumesSnapshotsTestJSON-1630091441-project] Returning 404 to user: Volume dd34099e-80dc-4342-b91c-55cd428140f8 could not be found. {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:26:52.013886 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2278315e-1dc1-46de-9b82-726b2a93d702 tempest-VolumesSnapshotsTestJSON-1630091441 tempest-VolumesSnapshotsTestJSON-1630091441-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/dd34099e-80dc-4342-b91c-55cd428140f8" status: 404 len: 109 microversion: 2.1 time: 0.157943 Jun 16 12:26:52.013886 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 15/30] 10.222.0.45 () {58 vars in 1244 bytes} [Thu Jun 16 12:26:51 2022] GET /compute/v2.1/os-volumes/dd34099e-80dc-4342-b91c-55cd428140f8 => generated 109 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 12:26:52.073328 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-bedecd9d-44c2-4b9b-aaf4-43e21a442792 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:26:52.079073 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-bedecd9d-44c2-4b9b-aaf4-43e21a442792 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: 331b2de0-3963-4186-bc19-f2fe2e97d860] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:26:52.115723 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bedecd9d-44c2-4b9b-aaf4-43e21a442792 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:26:52.116592 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bedecd9d-44c2-4b9b-aaf4-43e21a442792 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:26:52.120224 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bedecd9d-44c2-4b9b-aaf4-43e21a442792 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:26:52.138762 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bedecd9d-44c2-4b9b-aaf4-43e21a442792 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:26:52.322788 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.network.neutron [None req-ddfc612b-ab23-489b-b22f-d976aabb1173 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] validate_networks() for [('151a2bee-6229-46e8-95f9-7544fde552a8', None, None, None, None, None)] {{(pid=117606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 12:26:53.726386 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-bedecd9d-44c2-4b9b-aaf4-43e21a442792 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:26:53.758724 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-bedecd9d-44c2-4b9b-aaf4-43e21a442792 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860" status: 200 len: 1273 microversion: 2.1 time: 1.743649 Jun 16 12:26:53.770146 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 16/31] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:26:52 2022] GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860 => generated 1273 bytes in 1757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:26:53.790379 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-aec421da-e3f9-4233-850a-c13227013f1b tempest-VolumesSnapshotsTestJSON-1630091441 tempest-VolumesSnapshotsTestJSON-1630091441-project] Calling method '.version_select at 0x7f7c72dd9820>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:26:53.879316 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-aec421da-e3f9-4233-850a-c13227013f1b tempest-VolumesSnapshotsTestJSON-1630091441 tempest-VolumesSnapshotsTestJSON-1630091441-project] HTTP exception thrown: Volume dd34099e-80dc-4342-b91c-55cd428140f8 could not be found. Jun 16 12:26:53.883629 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-aec421da-e3f9-4233-850a-c13227013f1b tempest-VolumesSnapshotsTestJSON-1630091441 tempest-VolumesSnapshotsTestJSON-1630091441-project] Request method failure captured: Jun 16 12:26:53.883629 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: request: DELETE /compute/v2.1/os-volumes/dd34099e-80dc-4342-b91c-55cd428140f8 HTTP/1.1 Jun 16 12:26:53.883629 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Accept: application/json Jun 16 12:26:53.883629 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jun 16 12:26:53.883629 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Connection: close Jun 16 12:26:53.883629 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jun 16 12:26:53.883629 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jun 16 12:26:53.883629 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Host: 10.222.0.45 Jun 16 12:26:53.883629 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jun 16 12:26:53.883629 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jun 16 12:26:53.883629 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABiqyF3G1BnBa5x-EdGKx8Gl50Bt4uRuzDsF9aXZnGfjBexzQTrNo-q1YTC2C-bEiN5vlHdGuifT_XmSIZAQexrpbog7UAcTU9N4GXFbF8V1K9hc07vv-pfZ6W6QSHFbo2YnTUX4sxX6kQEgSRSoQYTqZZc9oy4Sq-z6Z3CabeKHy26o0U Jun 16 12:26:53.883629 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jun 16 12:26:53.883629 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jun 16 12:26:53.883629 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jun 16 12:26:53.883629 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jun 16 12:26:53.883629 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jun 16 12:26:53.883629 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jun 16 12:26:53.883629 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Id: c07177c1805343e0a1001b9684c1b0d6 Jun 16 12:26:53.883629 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1630091441 Jun 16 12:26:53.883629 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Role: member,reader Jun 16 12:26:53.883629 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Roles: member,reader Jun 16 12:26:53.885313 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c07177c1805343e0a1001b9684c1b0d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c07177c1805343e0a1001b9684c1b0d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c07177c1805343e0a1001b9684c1b0d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c07177c1805343e0a1001b9684c1b0d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Jun 16 12:26:53.885313 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1630091441 Jun 16 12:26:53.885313 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant-Id: c07177c1805343e0a1001b9684c1b0d6 Jun 16 12:26:53.885313 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1630091441 Jun 16 12:26:53.885313 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User: tempest-VolumesSnapshotsTestJSON-1630091441-project Jun 16 12:26:53.885313 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jun 16 12:26:53.885313 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jun 16 12:26:53.885313 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Id: 4764071f84f247e69197a69b03b76006 Jun 16 12:26:53.885313 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1630091441-project Jun 16 12:26:53.885313 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: method: Jun 16 12:26:53.885313 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: exception: Volume dd34099e-80dc-4342-b91c-55cd428140f8 could not be found. Jun 16 12:26:53.885313 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: action_args: {'id': 'dd34099e-80dc-4342-b91c-55cd428140f8'} Jun 16 12:26:53.885313 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:26:53.886224 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:26:53.886224 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 12:26:53.886224 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 12:26:53.886224 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 12:26:53.886224 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 12:26:53.886224 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 12:26:53.886224 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 12:26:53.886224 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 12:26:53.886224 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 12:26:53.886224 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 12:26:53.886224 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 12:26:53.886224 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 12:26:53.886224 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 12:26:53.886224 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 12:26:53.886224 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 12:26:53.886224 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume dd34099e-80dc-4342-b91c-55cd428140f8 could not be found. (HTTP 404) (Request-ID: req-f94c3e89-676d-457f-ab80-d5aa242f325a) Jun 16 12:26:53.886224 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:26:53.886224 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:26:53.886224 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:26:53.887630 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:26:53.887630 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 16 12:26:53.887630 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 16 12:26:53.887630 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 12:26:53.887630 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 12:26:53.887630 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 12:26:53.887630 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 12:26:53.887630 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 12:26:53.887630 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 12:26:53.887630 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 12:26:53.887630 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 12:26:53.887630 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 12:26:53.887630 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 12:26:53.887630 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 12:26:53.887630 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 12:26:53.887630 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 12:26:53.887630 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 12:26:53.887630 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 12:26:53.887630 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 12:26:53.895516 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 12:26:53.895516 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 12:26:53.895516 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 12:26:53.895516 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 12:26:53.895516 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume dd34099e-80dc-4342-b91c-55cd428140f8 could not be found. Jun 16 12:26:53.895516 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:26:53.895516 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:26:53.895516 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:26:53.895516 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:26:53.895516 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:26:53.895516 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:26:53.895516 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:26:53.895516 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:26:53.895516 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 12:26:53.895516 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 12:26:53.895516 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:26:53.895516 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:26:53.895516 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 16 12:26:53.895516 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:26:53.896738 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume dd34099e-80dc-4342-b91c-55cd428140f8 could not be found. Jun 16 12:26:53.896738 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:26:53.896738 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:26:53.896738 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:26:53.896738 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:26:53.896738 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:26:53.896738 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:26:53.896738 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:26:53.896738 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:26:53.896738 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume dd34099e-80dc-4342-b91c-55cd428140f8 could not be found. Jun 16 12:26:53.896738 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:26:53.898696 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-aec421da-e3f9-4233-850a-c13227013f1b tempest-VolumesSnapshotsTestJSON-1630091441 tempest-VolumesSnapshotsTestJSON-1630091441-project] Returning 404 to user: Volume dd34099e-80dc-4342-b91c-55cd428140f8 could not be found. {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:26:53.899906 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-aec421da-e3f9-4233-850a-c13227013f1b tempest-VolumesSnapshotsTestJSON-1630091441 tempest-VolumesSnapshotsTestJSON-1630091441-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/dd34099e-80dc-4342-b91c-55cd428140f8" status: 404 len: 109 microversion: 2.1 time: 0.128217 Jun 16 12:26:53.901421 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 17/32] 10.222.0.45 () {58 vars in 1247 bytes} [Thu Jun 16 12:26:53 2022] DELETE /compute/v2.1/os-volumes/dd34099e-80dc-4342-b91c-55cd428140f8 => generated 109 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 12:26:53.913390 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-03c77fec-3df0-42d3-b296-70ab5687c423 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1943840166", "imageRef": "c736a2d2-9d0d-41ec-b9fc-971428b0ff7a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2ef9c4f6-367f-48f5-a387-6aeb59709145"}], "security_groups": [{"name": "tempest-securitygroup--814447521"}], "key_name": "tempest-keypair-1163063130", "user_data": "}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:26:55.399559 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.network.neutron [None req-03c77fec-3df0-42d3-b296-70ab5687c423 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] validate_networks() for [('2ef9c4f6-367f-48f5-a387-6aeb59709145', None, None, None, None, None)] {{(pid=117607) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 12:26:57.078827 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-ddfc612b-ab23-489b-b22f-d976aabb1173 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Flavor limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 12:26:57.079341 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-ddfc612b-ab23-489b-b22f-d976aabb1173 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Image limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 12:26:57.079728 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-ddfc612b-ab23-489b-b22f-d976aabb1173 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Flavor pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 12:26:57.084346 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-ddfc612b-ab23-489b-b22f-d976aabb1173 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Image pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 12:26:57.085041 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-ddfc612b-ab23-489b-b22f-d976aabb1173 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 12:26:57.140183 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ddfc612b-ab23-489b-b22f-d976aabb1173 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:26:57.147930 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ddfc612b-ab23-489b-b22f-d976aabb1173 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:26:57.148989 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ddfc612b-ab23-489b-b22f-d976aabb1173 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:26:57.159048 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ddfc612b-ab23-489b-b22f-d976aabb1173 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:26:57.221241 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-ddfc612b-ab23-489b-b22f-d976aabb1173 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Getting quotas for project 3fce886a9a894240a0b3bd3af94d2465. Resources: {'instances', 'cores', 'ram'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 12:26:57.253063 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-ddfc612b-ab23-489b-b22f-d976aabb1173 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Getting quotas for user ed6b630c60d640afb1325215ea27acef and project 3fce886a9a894240a0b3bd3af94d2465. Resources: {'instances', 'cores', 'ram'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 12:26:57.285998 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ddfc612b-ab23-489b-b22f-d976aabb1173 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Going to run 1 instances... {{(pid=117606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 12:26:57.291493 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ddfc612b-ab23-489b-b22f-d976aabb1173 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: ddba5ba6-d9f4-493c-b15b-9443a5426682] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c736a2d2-9d0d-41ec-b9fc-971428b0ff7a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 12:26:57.458559 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ddfc612b-ab23-489b-b22f-d976aabb1173 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 6.312151 Jun 16 12:26:57.465927 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 16/33] 10.222.0.45 () {60 vars in 1146 bytes} [Thu Jun 16 12:26:51 2022] POST /compute/v2.1/servers => generated 401 bytes in 6321 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 12:26:57.480932 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f641e1a2-185a-4b71-af57-f91764d15a9c tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:26:57.483772 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f641e1a2-185a-4b71-af57-f91764d15a9c tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] [instance: c72b39de-9695-4833-8a7a-76af4eaa33d4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:26:57.503008 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f641e1a2-185a-4b71-af57-f91764d15a9c tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:26:57.503994 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f641e1a2-185a-4b71-af57-f91764d15a9c tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:26:57.505168 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f641e1a2-185a-4b71-af57-f91764d15a9c tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:26:57.506404 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f641e1a2-185a-4b71-af57-f91764d15a9c tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:26:58.000400 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f641e1a2-185a-4b71-af57-f91764d15a9c tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf22beda54e24b878e514304e7a62b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66000602298490b9e76d8138fdb825b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:26:58.042431 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f641e1a2-185a-4b71-af57-f91764d15a9c tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] 10.222.0.45 "GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4" status: 200 len: 1273 microversion: 2.1 time: 0.572592 Jun 16 12:26:58.048521 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 17/34] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:26:57 2022] GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4 => generated 1273 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:26:58.057954 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0db42ea1-2873-452f-a3f6-43327dc05f06 tempest-VolumesSnapshotsTestJSON-1630091441 tempest-VolumesSnapshotsTestJSON-1630091441-project] Calling method '.version_select at 0x7f7c726269d0>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:26:58.138690 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-0db42ea1-2873-452f-a3f6-43327dc05f06 tempest-VolumesSnapshotsTestJSON-1630091441 tempest-VolumesSnapshotsTestJSON-1630091441-project] HTTP exception thrown: Volume dd34099e-80dc-4342-b91c-55cd428140f8 could not be found. Jun 16 12:26:58.146632 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0db42ea1-2873-452f-a3f6-43327dc05f06 tempest-VolumesSnapshotsTestJSON-1630091441 tempest-VolumesSnapshotsTestJSON-1630091441-project] Request method failure captured: Jun 16 12:26:58.146632 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: request: GET /compute/v2.1/os-volumes/dd34099e-80dc-4342-b91c-55cd428140f8 HTTP/1.1 Jun 16 12:26:58.146632 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 16 12:26:58.146632 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 16 12:26:58.146632 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Connection: close Jun 16 12:26:58.146632 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 16 12:26:58.146632 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 16 12:26:58.146632 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Host: 10.222.0.45 Jun 16 12:26:58.146632 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 16 12:26:58.146632 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 16 12:26:58.146632 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABiqyF3G1BnBa5x-EdGKx8Gl50Bt4uRuzDsF9aXZnGfjBexzQTrNo-q1YTC2C-bEiN5vlHdGuifT_XmSIZAQexrpbog7UAcTU9N4GXFbF8V1K9hc07vv-pfZ6W6QSHFbo2YnTUX4sxX6kQEgSRSoQYTqZZc9oy4Sq-z6Z3CabeKHy26o0U Jun 16 12:26:58.146632 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 16 12:26:58.146632 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 16 12:26:58.146632 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 16 12:26:58.146632 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 16 12:26:58.146632 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 16 12:26:58.146632 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 16 12:26:58.146632 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Id: c07177c1805343e0a1001b9684c1b0d6 Jun 16 12:26:58.146632 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1630091441 Jun 16 12:26:58.146632 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 16 12:26:58.146632 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 16 12:26:58.148154 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c07177c1805343e0a1001b9684c1b0d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c07177c1805343e0a1001b9684c1b0d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c07177c1805343e0a1001b9684c1b0d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c07177c1805343e0a1001b9684c1b0d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Jun 16 12:26:58.148154 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1630091441 Jun 16 12:26:58.148154 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant-Id: c07177c1805343e0a1001b9684c1b0d6 Jun 16 12:26:58.148154 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1630091441 Jun 16 12:26:58.148154 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User: tempest-VolumesSnapshotsTestJSON-1630091441-project Jun 16 12:26:58.148154 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 16 12:26:58.148154 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 16 12:26:58.148154 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Id: 4764071f84f247e69197a69b03b76006 Jun 16 12:26:58.148154 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1630091441-project Jun 16 12:26:58.148154 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: method: Jun 16 12:26:58.148154 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: exception: Volume dd34099e-80dc-4342-b91c-55cd428140f8 could not be found. Jun 16 12:26:58.148154 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: action_args: {'id': 'dd34099e-80dc-4342-b91c-55cd428140f8'} Jun 16 12:26:58.148154 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:26:58.149230 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:26:58.149230 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 12:26:58.149230 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 12:26:58.149230 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 12:26:58.149230 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 12:26:58.149230 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 12:26:58.149230 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 12:26:58.149230 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 12:26:58.149230 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 12:26:58.149230 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 12:26:58.149230 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 12:26:58.149230 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 12:26:58.149230 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 12:26:58.149230 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 12:26:58.149230 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 12:26:58.149230 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume dd34099e-80dc-4342-b91c-55cd428140f8 could not be found. (HTTP 404) (Request-ID: req-b6e9da7a-0241-49bf-9ec7-ba50909645c6) Jun 16 12:26:58.149230 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:26:58.149230 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:26:58.149230 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:26:58.150704 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:26:58.150704 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 12:26:58.150704 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 12:26:58.150704 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 12:26:58.150704 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 12:26:58.150704 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 12:26:58.150704 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 12:26:58.150704 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 12:26:58.150704 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 12:26:58.150704 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 12:26:58.150704 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 12:26:58.150704 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 12:26:58.150704 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 12:26:58.150704 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 12:26:58.150704 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 12:26:58.150704 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 12:26:58.150704 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 12:26:58.150704 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 12:26:58.150704 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 12:26:58.151996 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 12:26:58.151996 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 12:26:58.151996 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 12:26:58.151996 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 12:26:58.151996 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume dd34099e-80dc-4342-b91c-55cd428140f8 could not be found. Jun 16 12:26:58.151996 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:26:58.151996 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:26:58.151996 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:26:58.151996 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:26:58.151996 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:26:58.151996 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:26:58.151996 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:26:58.151996 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:26:58.151996 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 12:26:58.151996 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 12:26:58.151996 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:26:58.151996 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:26:58.151996 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 12:26:58.151996 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:26:58.154023 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume dd34099e-80dc-4342-b91c-55cd428140f8 could not be found. Jun 16 12:26:58.154023 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:26:58.154023 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:26:58.154023 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:26:58.154023 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:26:58.154023 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:26:58.154023 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:26:58.154023 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:26:58.154023 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:26:58.154023 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume dd34099e-80dc-4342-b91c-55cd428140f8 could not be found. Jun 16 12:26:58.154023 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:26:58.156523 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0db42ea1-2873-452f-a3f6-43327dc05f06 tempest-VolumesSnapshotsTestJSON-1630091441 tempest-VolumesSnapshotsTestJSON-1630091441-project] Returning 404 to user: Volume dd34099e-80dc-4342-b91c-55cd428140f8 could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:26:58.161579 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0db42ea1-2873-452f-a3f6-43327dc05f06 tempest-VolumesSnapshotsTestJSON-1630091441 tempest-VolumesSnapshotsTestJSON-1630091441-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/dd34099e-80dc-4342-b91c-55cd428140f8" status: 404 len: 109 microversion: 2.1 time: 0.110769 Jun 16 12:26:58.164290 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 18/35] 10.222.0.45 () {58 vars in 1244 bytes} [Thu Jun 16 12:26:58 2022] GET /compute/v2.1/os-volumes/dd34099e-80dc-4342-b91c-55cd428140f8 => generated 109 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 12:26:58.184157 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c4b008e1-b29d-464c-9a16-997d9a192927 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:26:58.189845 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c4b008e1-b29d-464c-9a16-997d9a192927 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: 331b2de0-3963-4186-bc19-f2fe2e97d860] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:26:58.210440 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c4b008e1-b29d-464c-9a16-997d9a192927 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:26:58.210851 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c4b008e1-b29d-464c-9a16-997d9a192927 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:26:58.213347 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c4b008e1-b29d-464c-9a16-997d9a192927 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:26:58.213910 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c4b008e1-b29d-464c-9a16-997d9a192927 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:26:59.507446 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c4b008e1-b29d-464c-9a16-997d9a192927 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:26:59.522158 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c4b008e1-b29d-464c-9a16-997d9a192927 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860" status: 200 len: 1321 microversion: 2.1 time: 1.354300 Jun 16 12:26:59.523056 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 19/36] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:26:58 2022] GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860 => generated 1321 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:26:59.544202 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0042c86a-6d79-41ee-bb30-8bee0f492a81 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:26:59.544202 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0042c86a-6d79-41ee-bb30-8bee0f492a81 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: ddba5ba6-d9f4-493c-b15b-9443a5426682] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:26:59.567372 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell0:SELECT=4 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:26:59.577335 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0042c86a-6d79-41ee-bb30-8bee0f492a81 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:26:59.581221 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0042c86a-6d79-41ee-bb30-8bee0f492a81 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:26:59.583066 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0042c86a-6d79-41ee-bb30-8bee0f492a81 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:26:59.587260 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0042c86a-6d79-41ee-bb30-8bee0f492a81 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:26:59.865232 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0042c86a-6d79-41ee-bb30-8bee0f492a81 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:26:59.877525 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0042c86a-6d79-41ee-bb30-8bee0f492a81 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682" status: 200 len: 1292 microversion: 2.1 time: 0.347392 Jun 16 12:26:59.886142 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 20/37] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:26:59 2022] GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682 => generated 1292 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:26:59.897680 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a92737f4-cd0c-435a-a635-ca7d8e14ac69 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:26:59.921556 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a92737f4-cd0c-435a-a635-ca7d8e14ac69 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] [instance: c72b39de-9695-4833-8a7a-76af4eaa33d4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:26:59.944983 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a92737f4-cd0c-435a-a635-ca7d8e14ac69 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:26:59.948205 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a92737f4-cd0c-435a-a635-ca7d8e14ac69 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:26:59.951530 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a92737f4-cd0c-435a-a635-ca7d8e14ac69 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:26:59.952861 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a92737f4-cd0c-435a-a635-ca7d8e14ac69 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:00.625332 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-03c77fec-3df0-42d3-b296-70ab5687c423 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Flavor limits 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 12:27:00.626834 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-03c77fec-3df0-42d3-b296-70ab5687c423 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Image limits 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 12:27:00.627490 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-03c77fec-3df0-42d3-b296-70ab5687c423 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Flavor pref 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 12:27:00.630559 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-03c77fec-3df0-42d3-b296-70ab5687c423 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Image pref 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 12:27:00.632740 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-03c77fec-3df0-42d3-b296-70ab5687c423 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 12:27:00.704278 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-03c77fec-3df0-42d3-b296-70ab5687c423 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:00.704837 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-03c77fec-3df0-42d3-b296-70ab5687c423 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:00.714225 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-03c77fec-3df0-42d3-b296-70ab5687c423 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:00.723434 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-03c77fec-3df0-42d3-b296-70ab5687c423 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:00.803568 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-03c77fec-3df0-42d3-b296-70ab5687c423 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Getting quotas for project 501ea87534094acaa1b0a50b01901cac. Resources: {'instances', 'cores', 'ram'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 12:27:00.819843 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-03c77fec-3df0-42d3-b296-70ab5687c423 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Getting quotas for user cb370edc0f094c04904eb093a9eb0a42 and project 501ea87534094acaa1b0a50b01901cac. Resources: {'instances', 'cores', 'ram'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 12:27:00.849098 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-03c77fec-3df0-42d3-b296-70ab5687c423 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Going to run 1 instances... {{(pid=117607) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 12:27:00.856337 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-03c77fec-3df0-42d3-b296-70ab5687c423 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c736a2d2-9d0d-41ec-b9fc-971428b0ff7a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117607) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 12:27:00.983615 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-03c77fec-3df0-42d3-b296-70ab5687c423 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 7.078633 Jun 16 12:27:00.991009 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 18/38] 10.222.0.45 () {62 vars in 1187 bytes} [Thu Jun 16 12:26:53 2022] POST /compute/v2.1/servers => generated 401 bytes in 7089 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 16 12:27:01.010898 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1ea05bd7-fa47-4e43-9622-1d0e1ef4cba2 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:01.011511 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1ea05bd7-fa47-4e43-9622-1d0e1ef4cba2 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: 331b2de0-3963-4186-bc19-f2fe2e97d860] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:01.034114 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1ea05bd7-fa47-4e43-9622-1d0e1ef4cba2 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:01.034482 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1ea05bd7-fa47-4e43-9622-1d0e1ef4cba2 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:01.035268 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1ea05bd7-fa47-4e43-9622-1d0e1ef4cba2 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:01.035714 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1ea05bd7-fa47-4e43-9622-1d0e1ef4cba2 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:01.884308 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a92737f4-cd0c-435a-a635-ca7d8e14ac69 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf22beda54e24b878e514304e7a62b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66000602298490b9e76d8138fdb825b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:01.909283 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a92737f4-cd0c-435a-a635-ca7d8e14ac69 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] 10.222.0.45 "GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4" status: 200 len: 1273 microversion: 2.1 time: 2.021714 Jun 16 12:27:01.910298 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 21/39] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:26:59 2022] GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4 => generated 1273 bytes in 2023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:01.923752 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ddc41850-8abe-46c7-a043-299b13f64191 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:01.924574 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ddc41850-8abe-46c7-a043-299b13f64191 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: ddba5ba6-d9f4-493c-b15b-9443a5426682] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:01.937653 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ddc41850-8abe-46c7-a043-299b13f64191 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:01.938297 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ddc41850-8abe-46c7-a043-299b13f64191 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:01.939221 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ddc41850-8abe-46c7-a043-299b13f64191 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:01.939835 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ddc41850-8abe-46c7-a043-299b13f64191 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:02.335606 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ddc41850-8abe-46c7-a043-299b13f64191 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:02.349601 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ddc41850-8abe-46c7-a043-299b13f64191 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682" status: 200 len: 1298 microversion: 2.1 time: 0.430604 Jun 16 12:27:02.352780 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 22/40] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:01 2022] GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682 => generated 1298 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:02.482912 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1ea05bd7-fa47-4e43-9622-1d0e1ef4cba2 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:02.495073 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1ea05bd7-fa47-4e43-9622-1d0e1ef4cba2 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860" status: 200 len: 1321 microversion: 2.1 time: 1.492125 Jun 16 12:27:02.498060 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 19/41] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:00 2022] GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860 => generated 1321 bytes in 1506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:02.516951 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-9a583157-da6b-453d-9865-ac9c2c41ed27 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:02.519059 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-9a583157-da6b-453d-9865-ac9c2c41ed27 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:02.538837 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9a583157-da6b-453d-9865-ac9c2c41ed27 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:02.545280 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9a583157-da6b-453d-9865-ac9c2c41ed27 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:02.548015 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9a583157-da6b-453d-9865-ac9c2c41ed27 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:02.548622 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9a583157-da6b-453d-9865-ac9c2c41ed27 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:02.704099 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-83b5ec84-b226-407d-bdd5-dcd49caaa4ac req-5add4adf-05f3-4b86-b7f0-d36e1da8c307 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "331b2de0-3963-4186-bc19-f2fe2e97d860", "tag": "cf1f4f7a-bbf2-49a6-8df1-50c33977ca49"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:27:02.731872 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-83b5ec84-b226-407d-bdd5-dcd49caaa4ac req-5add4adf-05f3-4b86-b7f0-d36e1da8c307 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:02.738409 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-83b5ec84-b226-407d-bdd5-dcd49caaa4ac req-5add4adf-05f3-4b86-b7f0-d36e1da8c307 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:02.807372 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-83b5ec84-b226-407d-bdd5-dcd49caaa4ac req-5add4adf-05f3-4b86-b7f0-d36e1da8c307 service nova] Creating event network-changed:cf1f4f7a-bbf2-49a6-8df1-50c33977ca49 for instance 331b2de0-3963-4186-bc19-f2fe2e97d860 on hv-cinder-84614 Jun 16 12:27:02.808000 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-83b5ec84-b226-407d-bdd5-dcd49caaa4ac req-5add4adf-05f3-4b86-b7f0-d36e1da8c307 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117606) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 16 12:27:02.809406 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-38443ed6-1651-4579-a2bf-6f43f7c67136 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:02.818214 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-38443ed6-1651-4579-a2bf-6f43f7c67136 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:02.820330 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-38443ed6-1651-4579-a2bf-6f43f7c67136 None None] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:02.820782 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-38443ed6-1651-4579-a2bf-6f43f7c67136 None None] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:02.866008 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.compute.rpcapi [None req-38443ed6-1651-4579-a2bf-6f43f7c67136 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 16 12:27:02.869641 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-38443ed6-1651-4579-a2bf-6f43f7c67136 None None] Releasing lock "compute-rpcapi-router" {{(pid=117606) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 16 12:27:02.892700 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-9a583157-da6b-453d-9865-ac9c2c41ed27 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:02.938553 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-9a583157-da6b-453d-9865-ac9c2c41ed27 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:02.950652 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-9a583157-da6b-453d-9865-ac9c2c41ed27 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:02.953621 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-38443ed6-1651-4579-a2bf-6f43f7c67136 None None] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.599331 Jun 16 12:27:02.954850 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 23/42] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:27:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:27:02.955578 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-9a583157-da6b-453d-9865-ac9c2c41ed27 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1278 microversion: 2.20 time: 0.454220 Jun 16 12:27:02.960176 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 20/43] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:27:02 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1278 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:27:02.970745 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b9698284-41ce-444f-8319-1ce38cfd2232 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:02.971577 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b9698284-41ce-444f-8319-1ce38cfd2232 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] [instance: c72b39de-9695-4833-8a7a-76af4eaa33d4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:03.023447 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b9698284-41ce-444f-8319-1ce38cfd2232 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:03.023859 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b9698284-41ce-444f-8319-1ce38cfd2232 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:03.024685 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b9698284-41ce-444f-8319-1ce38cfd2232 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:03.025121 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b9698284-41ce-444f-8319-1ce38cfd2232 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:03.368904 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-64da825e-bef9-4f33-91da-418683fe36d3 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:03.369737 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-64da825e-bef9-4f33-91da-418683fe36d3 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: ddba5ba6-d9f4-493c-b15b-9443a5426682] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:03.377399 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-64da825e-bef9-4f33-91da-418683fe36d3 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:03.384219 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-64da825e-bef9-4f33-91da-418683fe36d3 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:03.385438 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-64da825e-bef9-4f33-91da-418683fe36d3 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:03.386179 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-64da825e-bef9-4f33-91da-418683fe36d3 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:03.993311 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-64da825e-bef9-4f33-91da-418683fe36d3 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:04.005614 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-64da825e-bef9-4f33-91da-418683fe36d3 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682" status: 200 len: 1298 microversion: 2.1 time: 0.640708 Jun 16 12:27:04.006235 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 21/44] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:03 2022] GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682 => generated 1298 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:27:04.047606 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6e328c9a-c362-4bd4-9199-38f14875b8ad tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:04.048230 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6e328c9a-c362-4bd4-9199-38f14875b8ad tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: 331b2de0-3963-4186-bc19-f2fe2e97d860] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:04.071866 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6e328c9a-c362-4bd4-9199-38f14875b8ad tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:04.072315 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6e328c9a-c362-4bd4-9199-38f14875b8ad tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:04.073098 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6e328c9a-c362-4bd4-9199-38f14875b8ad tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:04.073534 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6e328c9a-c362-4bd4-9199-38f14875b8ad tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:04.544464 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b9698284-41ce-444f-8319-1ce38cfd2232 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf22beda54e24b878e514304e7a62b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66000602298490b9e76d8138fdb825b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:04.562023 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b9698284-41ce-444f-8319-1ce38cfd2232 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] 10.222.0.45 "GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4" status: 200 len: 1315 microversion: 2.1 time: 1.605176 Jun 16 12:27:04.565167 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 24/45] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:02 2022] GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4 => generated 1315 bytes in 1610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:04.593373 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-44139d39-b4fd-468c-aaf9-d8a5450430a5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:04.597165 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-44139d39-b4fd-468c-aaf9-d8a5450430a5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:04.622850 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-44139d39-b4fd-468c-aaf9-d8a5450430a5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:04.625788 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-44139d39-b4fd-468c-aaf9-d8a5450430a5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:04.626682 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-44139d39-b4fd-468c-aaf9-d8a5450430a5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:04.632622 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-44139d39-b4fd-468c-aaf9-d8a5450430a5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:05.939217 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-44139d39-b4fd-468c-aaf9-d8a5450430a5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:05.951375 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-44139d39-b4fd-468c-aaf9-d8a5450430a5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:05.953513 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-44139d39-b4fd-468c-aaf9-d8a5450430a5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:05.957474 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-44139d39-b4fd-468c-aaf9-d8a5450430a5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1340 microversion: 2.20 time: 1.390437 Jun 16 12:27:05.973125 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 25/46] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:27:04 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1340 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:27:05.985994 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a01be231-1fc0-4511-b0db-5f2e5654363e tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:05.986928 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a01be231-1fc0-4511-b0db-5f2e5654363e tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: ddba5ba6-d9f4-493c-b15b-9443a5426682] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:05.993950 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a01be231-1fc0-4511-b0db-5f2e5654363e tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:05.994768 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a01be231-1fc0-4511-b0db-5f2e5654363e tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:05.995982 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a01be231-1fc0-4511-b0db-5f2e5654363e tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:05.996856 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a01be231-1fc0-4511-b0db-5f2e5654363e tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:06.590371 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a01be231-1fc0-4511-b0db-5f2e5654363e tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:06.603826 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a01be231-1fc0-4511-b0db-5f2e5654363e tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682" status: 200 len: 1298 microversion: 2.1 time: 0.625437 Jun 16 12:27:06.605126 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 26/47] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:05 2022] GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682 => generated 1298 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:06.622519 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-bf953199-9d2e-47f4-8e2d-6aab08f027fc tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:06.623134 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-bf953199-9d2e-47f4-8e2d-6aab08f027fc tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] [instance: c72b39de-9695-4833-8a7a-76af4eaa33d4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:06.636775 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bf953199-9d2e-47f4-8e2d-6aab08f027fc tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:06.637969 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bf953199-9d2e-47f4-8e2d-6aab08f027fc tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:06.642829 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bf953199-9d2e-47f4-8e2d-6aab08f027fc tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:06.644888 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bf953199-9d2e-47f4-8e2d-6aab08f027fc tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:07.273789 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=22 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:07.432015 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6e328c9a-c362-4bd4-9199-38f14875b8ad tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:07.443858 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6e328c9a-c362-4bd4-9199-38f14875b8ad tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860" status: 200 len: 1321 microversion: 2.1 time: 3.424337 Jun 16 12:27:07.444720 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 22/48] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:04 2022] GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860 => generated 1321 bytes in 3438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:07.458450 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1c924644-e8ce-46a8-8b1d-2d8e6bf54289 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:07.459793 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1c924644-e8ce-46a8-8b1d-2d8e6bf54289 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:07.472396 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=9 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:07.478446 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1c924644-e8ce-46a8-8b1d-2d8e6bf54289 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:07.480976 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1c924644-e8ce-46a8-8b1d-2d8e6bf54289 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:07.483087 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1c924644-e8ce-46a8-8b1d-2d8e6bf54289 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:07.483911 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1c924644-e8ce-46a8-8b1d-2d8e6bf54289 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:07.572622 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-bf953199-9d2e-47f4-8e2d-6aab08f027fc tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf22beda54e24b878e514304e7a62b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66000602298490b9e76d8138fdb825b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:07.613822 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-bf953199-9d2e-47f4-8e2d-6aab08f027fc tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] 10.222.0.45 "GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4" status: 200 len: 1315 microversion: 2.1 time: 1.007262 Jun 16 12:27:07.617806 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 27/49] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:06 2022] GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4 => generated 1315 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:07.884503 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-dd5621bf-3582-4639-a838-95dadd957b2d req-bc2125a8-cf69-4aca-92ed-56be2d19122c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7405152-1807-4b2a-8701-ef2b2a8cbafb", "tag": "e3f227d9-42cf-4cc8-b18b-eeba97dbf2ba"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:27:07.898671 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-dd5621bf-3582-4639-a838-95dadd957b2d req-bc2125a8-cf69-4aca-92ed-56be2d19122c service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:07.904909 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-dd5621bf-3582-4639-a838-95dadd957b2d req-bc2125a8-cf69-4aca-92ed-56be2d19122c service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:07.928222 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-dd5621bf-3582-4639-a838-95dadd957b2d req-bc2125a8-cf69-4aca-92ed-56be2d19122c service nova] Creating event network-changed:e3f227d9-42cf-4cc8-b18b-eeba97dbf2ba for instance c7405152-1807-4b2a-8701-ef2b2a8cbafb on hv-cinder-84614 Jun 16 12:27:07.939764 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-dd5621bf-3582-4639-a838-95dadd957b2d req-bc2125a8-cf69-4aca-92ed-56be2d19122c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.317792 Jun 16 12:27:07.944309 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 28/50] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:27:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:27:07.949482 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b1352792-7770-47d6-8981-a2059c4c9094 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:07.950999 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b1352792-7770-47d6-8981-a2059c4c9094 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: ddba5ba6-d9f4-493c-b15b-9443a5426682] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:07.969007 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b1352792-7770-47d6-8981-a2059c4c9094 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:07.975305 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b1352792-7770-47d6-8981-a2059c4c9094 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:07.978574 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b1352792-7770-47d6-8981-a2059c4c9094 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:07.979227 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b1352792-7770-47d6-8981-a2059c4c9094 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:08.277417 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1c924644-e8ce-46a8-8b1d-2d8e6bf54289 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:08.279890 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b1352792-7770-47d6-8981-a2059c4c9094 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:08.298307 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1c924644-e8ce-46a8-8b1d-2d8e6bf54289 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:08.299445 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b1352792-7770-47d6-8981-a2059c4c9094 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682" status: 200 len: 1298 microversion: 2.1 time: 0.353864 Jun 16 12:27:08.301778 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 29/51] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:07 2022] GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682 => generated 1298 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:08.302638 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1c924644-e8ce-46a8-8b1d-2d8e6bf54289 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:08.304278 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1c924644-e8ce-46a8-8b1d-2d8e6bf54289 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1407 microversion: 2.20 time: 0.857548 Jun 16 12:27:08.305424 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 23/52] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:27:07 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1407 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:27:08.463193 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1f2c9b49-b2e1-41f1-be3a-69b121057c8d tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:08.463818 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1f2c9b49-b2e1-41f1-be3a-69b121057c8d tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: 331b2de0-3963-4186-bc19-f2fe2e97d860] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:08.472195 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1f2c9b49-b2e1-41f1-be3a-69b121057c8d tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:08.472654 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1f2c9b49-b2e1-41f1-be3a-69b121057c8d tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:08.473426 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1f2c9b49-b2e1-41f1-be3a-69b121057c8d tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:08.480555 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1f2c9b49-b2e1-41f1-be3a-69b121057c8d tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:08.641056 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-94f308e1-249a-4439-a233-81096205f67d tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:08.642360 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-94f308e1-249a-4439-a233-81096205f67d tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] [instance: c72b39de-9695-4833-8a7a-76af4eaa33d4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:08.665359 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-94f308e1-249a-4439-a233-81096205f67d tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:08.666217 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-94f308e1-249a-4439-a233-81096205f67d tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:08.670429 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-94f308e1-249a-4439-a233-81096205f67d tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:08.671023 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-94f308e1-249a-4439-a233-81096205f67d tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:09.341521 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1f2c9b49-b2e1-41f1-be3a-69b121057c8d tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:09.352064 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1f2c9b49-b2e1-41f1-be3a-69b121057c8d tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860" status: 200 len: 1321 microversion: 2.1 time: 0.894180 Jun 16 12:27:09.353564 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 30/53] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:08 2022] GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860 => generated 1321 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:09.359889 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-d5f52fec-4b8b-45a9-aeaf-199535485163 req-0d5f1e8d-5c1f-4332-bd0c-ab25a3dc368b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8528919e-1e7a-4807-9b11-ae225e65d4df", "tag": "ee66a439-1483-44c8-a66e-9b4920bb00e9"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:27:09.369731 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-d5f52fec-4b8b-45a9-aeaf-199535485163 req-0d5f1e8d-5c1f-4332-bd0c-ab25a3dc368b service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:09.370365 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-d5f52fec-4b8b-45a9-aeaf-199535485163 req-0d5f1e8d-5c1f-4332-bd0c-ab25a3dc368b service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:09.389461 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-d5f52fec-4b8b-45a9-aeaf-199535485163 req-0d5f1e8d-5c1f-4332-bd0c-ab25a3dc368b service nova] Creating event network-changed:ee66a439-1483-44c8-a66e-9b4920bb00e9 for instance 8528919e-1e7a-4807-9b11-ae225e65d4df on hv-cinder-84614 Jun 16 12:27:09.396892 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-d5f52fec-4b8b-45a9-aeaf-199535485163 req-0d5f1e8d-5c1f-4332-bd0c-ab25a3dc368b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041526 Jun 16 12:27:09.398684 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 31/54] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:27:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:27:09.408121 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1e4f2ec9-047f-4eb5-8832-8a498a7163b2 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:09.409076 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1e4f2ec9-047f-4eb5-8832-8a498a7163b2 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: ddba5ba6-d9f4-493c-b15b-9443a5426682] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:09.421171 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1e4f2ec9-047f-4eb5-8832-8a498a7163b2 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:09.421970 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1e4f2ec9-047f-4eb5-8832-8a498a7163b2 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:09.422984 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1e4f2ec9-047f-4eb5-8832-8a498a7163b2 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:09.424131 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1e4f2ec9-047f-4eb5-8832-8a498a7163b2 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:09.619403 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-94f308e1-249a-4439-a233-81096205f67d tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf22beda54e24b878e514304e7a62b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66000602298490b9e76d8138fdb825b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:09.628793 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-94f308e1-249a-4439-a233-81096205f67d tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] 10.222.0.45 "GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4" status: 200 len: 1315 microversion: 2.1 time: 0.992627 Jun 16 12:27:09.630630 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 24/55] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:08 2022] GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4 => generated 1315 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:09.638171 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1ef54da6-1bd9-45d7-b52c-b1cfb44020ae tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:09.640077 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1ef54da6-1bd9-45d7-b52c-b1cfb44020ae tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:09.648921 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1ef54da6-1bd9-45d7-b52c-b1cfb44020ae tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:09.650124 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1ef54da6-1bd9-45d7-b52c-b1cfb44020ae tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:09.651174 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1ef54da6-1bd9-45d7-b52c-b1cfb44020ae tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:09.651997 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1ef54da6-1bd9-45d7-b52c-b1cfb44020ae tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:10.110562 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1e4f2ec9-047f-4eb5-8832-8a498a7163b2 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:10.123793 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1e4f2ec9-047f-4eb5-8832-8a498a7163b2 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682" status: 200 len: 1365 microversion: 2.1 time: 0.723196 Jun 16 12:27:10.125401 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 32/56] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:09 2022] GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682 => generated 1365 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:10.131696 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-0b538519-5496-4210-80e8-d74a03d5c3ee req-e753a800-809e-422c-9f55-f34e6c444b0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c72b39de-9695-4833-8a7a-76af4eaa33d4", "tag": "c043bee4-c23f-4c99-b00d-fb8989bd7376"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:27:10.173629 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-0b538519-5496-4210-80e8-d74a03d5c3ee req-e753a800-809e-422c-9f55-f34e6c444b0d service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:10.179883 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-0b538519-5496-4210-80e8-d74a03d5c3ee req-e753a800-809e-422c-9f55-f34e6c444b0d service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:10.210408 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1ef54da6-1bd9-45d7-b52c-b1cfb44020ae tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:10.220239 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-0b538519-5496-4210-80e8-d74a03d5c3ee req-e753a800-809e-422c-9f55-f34e6c444b0d service nova] Creating event network-changed:c043bee4-c23f-4c99-b00d-fb8989bd7376 for instance c72b39de-9695-4833-8a7a-76af4eaa33d4 on hv-cinder-84614 Jun 16 12:27:10.228136 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-0b538519-5496-4210-80e8-d74a03d5c3ee req-e753a800-809e-422c-9f55-f34e6c444b0d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100093 Jun 16 12:27:10.229362 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 33/57] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:27:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:27:10.233858 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1ef54da6-1bd9-45d7-b52c-b1cfb44020ae tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:10.235752 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1ef54da6-1bd9-45d7-b52c-b1cfb44020ae tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:10.237121 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1ef54da6-1bd9-45d7-b52c-b1cfb44020ae tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1407 microversion: 2.20 time: 0.604676 Jun 16 12:27:10.238461 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 25/58] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:27:09 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1407 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:27:10.374516 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-87665d51-ef2f-4b29-8165-67df7b801634 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:10.375225 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-87665d51-ef2f-4b29-8165-67df7b801634 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: 331b2de0-3963-4186-bc19-f2fe2e97d860] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:10.387120 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-87665d51-ef2f-4b29-8165-67df7b801634 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:10.388675 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-87665d51-ef2f-4b29-8165-67df7b801634 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:10.394009 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-87665d51-ef2f-4b29-8165-67df7b801634 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:10.394962 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-87665d51-ef2f-4b29-8165-67df7b801634 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:10.650050 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6521bffa-040b-4b6e-83d3-5c4f2e1fa869 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:10.650050 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6521bffa-040b-4b6e-83d3-5c4f2e1fa869 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] [instance: c72b39de-9695-4833-8a7a-76af4eaa33d4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:10.661382 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6521bffa-040b-4b6e-83d3-5c4f2e1fa869 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:10.661845 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6521bffa-040b-4b6e-83d3-5c4f2e1fa869 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:10.662655 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6521bffa-040b-4b6e-83d3-5c4f2e1fa869 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:10.663101 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6521bffa-040b-4b6e-83d3-5c4f2e1fa869 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:10.717842 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-87665d51-ef2f-4b29-8165-67df7b801634 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:10.726755 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-87665d51-ef2f-4b29-8165-67df7b801634 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860" status: 200 len: 1321 microversion: 2.1 time: 0.356750 Jun 16 12:27:10.732425 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 34/59] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:10 2022] GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860 => generated 1321 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:10.773958 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell0:SELECT=2 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:10.839975 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell0:SELECT=24 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:10.983311 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6521bffa-040b-4b6e-83d3-5c4f2e1fa869 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf22beda54e24b878e514304e7a62b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66000602298490b9e76d8138fdb825b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:10.992165 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6521bffa-040b-4b6e-83d3-5c4f2e1fa869 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] 10.222.0.45 "GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4" status: 200 len: 1315 microversion: 2.1 time: 0.348817 Jun 16 12:27:10.996812 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 26/60] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:10 2022] GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4 => generated 1315 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:11.143536 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8750c273-82c5-4267-a632-db4dc9166e40 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:11.144212 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8750c273-82c5-4267-a632-db4dc9166e40 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: ddba5ba6-d9f4-493c-b15b-9443a5426682] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:11.154341 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8750c273-82c5-4267-a632-db4dc9166e40 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:11.154844 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8750c273-82c5-4267-a632-db4dc9166e40 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:11.155611 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8750c273-82c5-4267-a632-db4dc9166e40 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:11.156058 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8750c273-82c5-4267-a632-db4dc9166e40 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:11.257434 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1641c5c9-654f-43cc-a352-1aa1f4b97ae8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:11.258146 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1641c5c9-654f-43cc-a352-1aa1f4b97ae8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:11.270995 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1641c5c9-654f-43cc-a352-1aa1f4b97ae8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:11.272020 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1641c5c9-654f-43cc-a352-1aa1f4b97ae8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:11.273015 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1641c5c9-654f-43cc-a352-1aa1f4b97ae8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:11.273649 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1641c5c9-654f-43cc-a352-1aa1f4b97ae8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:11.568430 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8750c273-82c5-4267-a632-db4dc9166e40 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:11.577719 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8750c273-82c5-4267-a632-db4dc9166e40 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682" status: 200 len: 1365 microversion: 2.1 time: 0.440181 Jun 16 12:27:11.586390 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 35/61] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:11 2022] GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682 => generated 1365 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:11.632453 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1641c5c9-654f-43cc-a352-1aa1f4b97ae8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:11.643360 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1641c5c9-654f-43cc-a352-1aa1f4b97ae8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:11.645107 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1641c5c9-654f-43cc-a352-1aa1f4b97ae8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:11.646427 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1641c5c9-654f-43cc-a352-1aa1f4b97ae8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1407 microversion: 2.20 time: 0.394239 Jun 16 12:27:11.647050 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 27/62] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:27:11 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1407 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 12:27:11.745750 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d4ce0acf-2250-4ceb-897a-ca852c5eb10f tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:11.747966 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d4ce0acf-2250-4ceb-897a-ca852c5eb10f tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: 331b2de0-3963-4186-bc19-f2fe2e97d860] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:11.757990 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:11.764450 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d4ce0acf-2250-4ceb-897a-ca852c5eb10f tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:11.765211 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d4ce0acf-2250-4ceb-897a-ca852c5eb10f tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:11.766267 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d4ce0acf-2250-4ceb-897a-ca852c5eb10f tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:11.766928 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d4ce0acf-2250-4ceb-897a-ca852c5eb10f tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:11.804450 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:12.015849 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ed1dd646-6e3d-4d70-ba2b-63e9fcd3673b tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:12.016471 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ed1dd646-6e3d-4d70-ba2b-63e9fcd3673b tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] [instance: c72b39de-9695-4833-8a7a-76af4eaa33d4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:12.027184 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ed1dd646-6e3d-4d70-ba2b-63e9fcd3673b tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:12.029792 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ed1dd646-6e3d-4d70-ba2b-63e9fcd3673b tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:12.030619 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ed1dd646-6e3d-4d70-ba2b-63e9fcd3673b tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:12.031063 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ed1dd646-6e3d-4d70-ba2b-63e9fcd3673b tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:12.771651 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d4ce0acf-2250-4ceb-897a-ca852c5eb10f tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:12.791329 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d4ce0acf-2250-4ceb-897a-ca852c5eb10f tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860" status: 200 len: 1321 microversion: 2.1 time: 1.051376 Jun 16 12:27:12.794208 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 36/63] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:11 2022] GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860 => generated 1321 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:12.801732 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-91512cee-dcb2-4776-848b-5535ddbb60f8 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:12.804132 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-91512cee-dcb2-4776-848b-5535ddbb60f8 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: ddba5ba6-d9f4-493c-b15b-9443a5426682] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:12.815215 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-91512cee-dcb2-4776-848b-5535ddbb60f8 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:12.815900 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-91512cee-dcb2-4776-848b-5535ddbb60f8 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:12.816909 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-91512cee-dcb2-4776-848b-5535ddbb60f8 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:12.823351 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-91512cee-dcb2-4776-848b-5535ddbb60f8 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:12.864056 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=6 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:12.924399 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ed1dd646-6e3d-4d70-ba2b-63e9fcd3673b tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf22beda54e24b878e514304e7a62b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66000602298490b9e76d8138fdb825b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:12.936207 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ed1dd646-6e3d-4d70-ba2b-63e9fcd3673b tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] 10.222.0.45 "GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4" status: 200 len: 1315 microversion: 2.1 time: 0.925399 Jun 16 12:27:12.938504 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 28/64] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:12 2022] GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4 => generated 1315 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:12.950633 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-57f6b133-fb7e-45b3-bc1e-e0d3a5fec425 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:12.955125 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-57f6b133-fb7e-45b3-bc1e-e0d3a5fec425 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:12.974477 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-57f6b133-fb7e-45b3-bc1e-e0d3a5fec425 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:12.974938 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-57f6b133-fb7e-45b3-bc1e-e0d3a5fec425 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:12.978612 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-57f6b133-fb7e-45b3-bc1e-e0d3a5fec425 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:12.979100 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-57f6b133-fb7e-45b3-bc1e-e0d3a5fec425 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:13.158714 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-91512cee-dcb2-4776-848b-5535ddbb60f8 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:13.167654 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-91512cee-dcb2-4776-848b-5535ddbb60f8 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682" status: 200 len: 1365 microversion: 2.1 time: 0.371864 Jun 16 12:27:13.171404 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 37/65] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:12 2022] GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682 => generated 1365 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:13.248403 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-57f6b133-fb7e-45b3-bc1e-e0d3a5fec425 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:13.259650 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-57f6b133-fb7e-45b3-bc1e-e0d3a5fec425 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:13.266253 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-57f6b133-fb7e-45b3-bc1e-e0d3a5fec425 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:13.270065 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-57f6b133-fb7e-45b3-bc1e-e0d3a5fec425 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1407 microversion: 2.20 time: 0.326751 Jun 16 12:27:13.270817 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 29/66] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:27:12 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1407 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:27:13.811514 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8b2caccb-6677-48ce-9538-7d1dc62bfea0 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:13.812134 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8b2caccb-6677-48ce-9538-7d1dc62bfea0 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: 331b2de0-3963-4186-bc19-f2fe2e97d860] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:13.818639 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8b2caccb-6677-48ce-9538-7d1dc62bfea0 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:13.819377 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8b2caccb-6677-48ce-9538-7d1dc62bfea0 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:13.820587 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8b2caccb-6677-48ce-9538-7d1dc62bfea0 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:13.821251 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8b2caccb-6677-48ce-9538-7d1dc62bfea0 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:13.878783 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-2ea69c04-973e-4dfd-b319-14647de2babd req-e43d8f1c-edd9-4b98-9eac-ec8ebe5a1e63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddba5ba6-d9f4-493c-b15b-9443a5426682", "tag": "80765d24-d4d2-42f5-b6b1-6bb0e8d83b1d"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:27:13.904994 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-2ea69c04-973e-4dfd-b319-14647de2babd req-e43d8f1c-edd9-4b98-9eac-ec8ebe5a1e63 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:13.906684 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-2ea69c04-973e-4dfd-b319-14647de2babd req-e43d8f1c-edd9-4b98-9eac-ec8ebe5a1e63 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:13.943323 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-2ea69c04-973e-4dfd-b319-14647de2babd req-e43d8f1c-edd9-4b98-9eac-ec8ebe5a1e63 service nova] Creating event network-changed:80765d24-d4d2-42f5-b6b1-6bb0e8d83b1d for instance ddba5ba6-d9f4-493c-b15b-9443a5426682 on hv-cinder-84614 Jun 16 12:27:13.944628 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-2ea69c04-973e-4dfd-b319-14647de2babd req-e43d8f1c-edd9-4b98-9eac-ec8ebe5a1e63 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117607) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 16 12:27:13.946573 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2810abba-6062-4e32-b431-4ee3273ce2d0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:13.947856 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2810abba-6062-4e32-b431-4ee3273ce2d0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:13.949719 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2810abba-6062-4e32-b431-4ee3273ce2d0 None None] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:13.950418 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2810abba-6062-4e32-b431-4ee3273ce2d0 None None] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:13.962651 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.compute.rpcapi [None req-2810abba-6062-4e32-b431-4ee3273ce2d0 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 16 12:27:13.963889 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2810abba-6062-4e32-b431-4ee3273ce2d0 None None] Releasing lock "compute-rpcapi-router" {{(pid=117607) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 16 12:27:13.995294 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2810abba-6062-4e32-b431-4ee3273ce2d0 None None] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119931 Jun 16 12:27:13.995702 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 30/67] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:27:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 12:27:14.001728 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-badb548b-0a6f-4217-b4ef-d54fe191c16d tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:14.002455 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-badb548b-0a6f-4217-b4ef-d54fe191c16d tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] [instance: c72b39de-9695-4833-8a7a-76af4eaa33d4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:14.023448 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-badb548b-0a6f-4217-b4ef-d54fe191c16d tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:14.024500 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-badb548b-0a6f-4217-b4ef-d54fe191c16d tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:14.025955 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-badb548b-0a6f-4217-b4ef-d54fe191c16d tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:14.031004 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-badb548b-0a6f-4217-b4ef-d54fe191c16d tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:14.863409 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8b2caccb-6677-48ce-9538-7d1dc62bfea0 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:14.874006 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8b2caccb-6677-48ce-9538-7d1dc62bfea0 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860" status: 200 len: 1321 microversion: 2.1 time: 1.065456 Jun 16 12:27:14.905381 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 38/68] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:13 2022] GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860 => generated 1321 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:14.911808 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1d09a1a2-2878-4fb8-b906-f867bdd93ff6 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:14.912934 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1d09a1a2-2878-4fb8-b906-f867bdd93ff6 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: ddba5ba6-d9f4-493c-b15b-9443a5426682] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:14.924890 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-badb548b-0a6f-4217-b4ef-d54fe191c16d tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf22beda54e24b878e514304e7a62b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66000602298490b9e76d8138fdb825b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:14.930520 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1d09a1a2-2878-4fb8-b906-f867bdd93ff6 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:14.931511 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1d09a1a2-2878-4fb8-b906-f867bdd93ff6 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:14.932526 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1d09a1a2-2878-4fb8-b906-f867bdd93ff6 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:14.933400 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1d09a1a2-2878-4fb8-b906-f867bdd93ff6 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:14.934211 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-badb548b-0a6f-4217-b4ef-d54fe191c16d tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] 10.222.0.45 "GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4" status: 200 len: 1315 microversion: 2.1 time: 0.936742 Jun 16 12:27:14.937185 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 31/69] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:13 2022] GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4 => generated 1315 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:14.948107 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f3621cc5-4540-4d3e-9179-29c8026ae274 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:14.948717 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f3621cc5-4540-4d3e-9179-29c8026ae274 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:14.967322 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f3621cc5-4540-4d3e-9179-29c8026ae274 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:14.970039 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f3621cc5-4540-4d3e-9179-29c8026ae274 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:14.970938 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f3621cc5-4540-4d3e-9179-29c8026ae274 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:14.972721 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f3621cc5-4540-4d3e-9179-29c8026ae274 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:15.144139 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1d09a1a2-2878-4fb8-b906-f867bdd93ff6 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:15.154054 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1d09a1a2-2878-4fb8-b906-f867bdd93ff6 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682" status: 200 len: 1365 microversion: 2.1 time: 0.255613 Jun 16 12:27:15.154909 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 39/70] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:14 2022] GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682 => generated 1365 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:15.171680 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f3621cc5-4540-4d3e-9179-29c8026ae274 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:15.186506 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f3621cc5-4540-4d3e-9179-29c8026ae274 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:15.188231 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f3621cc5-4540-4d3e-9179-29c8026ae274 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:15.189343 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f3621cc5-4540-4d3e-9179-29c8026ae274 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1407 microversion: 2.20 time: 0.250917 Jun 16 12:27:15.189935 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 32/71] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:27:14 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1407 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:27:15.839246 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-f762bfef-f32f-4ea3-8403-5369952480f7 req-9462745a-9e90-4f33-96c5-42d7b144691c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "331b2de0-3963-4186-bc19-f2fe2e97d860", "name": "network-vif-plugged", "status": "completed", "tag": "cf1f4f7a-bbf2-49a6-8df1-50c33977ca49"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:27:15.849397 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-f762bfef-f32f-4ea3-8403-5369952480f7 req-9462745a-9e90-4f33-96c5-42d7b144691c service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:15.849863 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-f762bfef-f32f-4ea3-8403-5369952480f7 req-9462745a-9e90-4f33-96c5-42d7b144691c service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:15.866267 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-f762bfef-f32f-4ea3-8403-5369952480f7 req-9462745a-9e90-4f33-96c5-42d7b144691c service nova] Creating event network-vif-plugged:cf1f4f7a-bbf2-49a6-8df1-50c33977ca49 for instance 331b2de0-3963-4186-bc19-f2fe2e97d860 on hv-cinder-84614 Jun 16 12:27:15.871312 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-f762bfef-f32f-4ea3-8403-5369952480f7 req-9462745a-9e90-4f33-96c5-42d7b144691c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.292028 Jun 16 12:27:15.871910 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 40/72] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:27:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:27:15.913553 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a92c9777-1604-44e6-b2b9-d87866a61b8f tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:15.914457 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a92c9777-1604-44e6-b2b9-d87866a61b8f tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: 331b2de0-3963-4186-bc19-f2fe2e97d860] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:15.920589 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a92c9777-1604-44e6-b2b9-d87866a61b8f tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:15.921042 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a92c9777-1604-44e6-b2b9-d87866a61b8f tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:15.921807 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a92c9777-1604-44e6-b2b9-d87866a61b8f tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:15.922424 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a92c9777-1604-44e6-b2b9-d87866a61b8f tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:15.926741 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=95 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:15.953392 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b9ee6f67-bb3c-4568-a088-343c946d0a4d tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:15.954349 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b9ee6f67-bb3c-4568-a088-343c946d0a4d tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] [instance: c72b39de-9695-4833-8a7a-76af4eaa33d4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:15.960800 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b9ee6f67-bb3c-4568-a088-343c946d0a4d tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:15.961247 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b9ee6f67-bb3c-4568-a088-343c946d0a4d tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:15.962028 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b9ee6f67-bb3c-4568-a088-343c946d0a4d tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:15.962679 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b9ee6f67-bb3c-4568-a088-343c946d0a4d tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:16.135468 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a92c9777-1604-44e6-b2b9-d87866a61b8f tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:16.146913 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a92c9777-1604-44e6-b2b9-d87866a61b8f tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860" status: 200 len: 1321 microversion: 2.1 time: 0.238173 Jun 16 12:27:16.147517 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 33/73] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:15 2022] GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860 => generated 1321 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:16.173411 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b9ee6f67-bb3c-4568-a088-343c946d0a4d tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf22beda54e24b878e514304e7a62b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66000602298490b9e76d8138fdb825b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:16.179947 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-bfb93a46-4a4b-46e4-957d-62ed5c1fad40 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:16.188210 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b9ee6f67-bb3c-4568-a088-343c946d0a4d tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] 10.222.0.45 "GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4" status: 200 len: 1315 microversion: 2.1 time: 0.238792 Jun 16 12:27:16.188808 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 41/74] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:15 2022] GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4 => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:16.189367 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-bfb93a46-4a4b-46e4-957d-62ed5c1fad40 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: ddba5ba6-d9f4-493c-b15b-9443a5426682] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:16.195761 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bfb93a46-4a4b-46e4-957d-62ed5c1fad40 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:16.196209 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bfb93a46-4a4b-46e4-957d-62ed5c1fad40 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:16.196973 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bfb93a46-4a4b-46e4-957d-62ed5c1fad40 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:16.197412 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bfb93a46-4a4b-46e4-957d-62ed5c1fad40 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:16.209736 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4dfca9fe-c295-4d83-8c11-e09a88bbbe74 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:16.210959 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4dfca9fe-c295-4d83-8c11-e09a88bbbe74 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:16.219107 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4dfca9fe-c295-4d83-8c11-e09a88bbbe74 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:16.219832 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4dfca9fe-c295-4d83-8c11-e09a88bbbe74 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:16.220899 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4dfca9fe-c295-4d83-8c11-e09a88bbbe74 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:16.221460 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4dfca9fe-c295-4d83-8c11-e09a88bbbe74 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:17.010048 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-bfb93a46-4a4b-46e4-957d-62ed5c1fad40 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:17.022395 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-bfb93a46-4a4b-46e4-957d-62ed5c1fad40 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682" status: 200 len: 1365 microversion: 2.1 time: 0.854833 Jun 16 12:27:17.023159 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 34/75] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:16 2022] GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682 => generated 1365 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:27:17.165134 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-59817bd9-38a6-4ac5-a7a2-1ffc6dc4a0c0 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:17.166085 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-59817bd9-38a6-4ac5-a7a2-1ffc6dc4a0c0 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: 331b2de0-3963-4186-bc19-f2fe2e97d860] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:17.179675 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-59817bd9-38a6-4ac5-a7a2-1ffc6dc4a0c0 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:17.180690 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-59817bd9-38a6-4ac5-a7a2-1ffc6dc4a0c0 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:17.181890 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-59817bd9-38a6-4ac5-a7a2-1ffc6dc4a0c0 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:17.183057 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-59817bd9-38a6-4ac5-a7a2-1ffc6dc4a0c0 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:17.397265 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4dfca9fe-c295-4d83-8c11-e09a88bbbe74 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:17.420863 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4dfca9fe-c295-4d83-8c11-e09a88bbbe74 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:17.427822 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4dfca9fe-c295-4d83-8c11-e09a88bbbe74 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:17.431791 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4dfca9fe-c295-4d83-8c11-e09a88bbbe74 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1407 microversion: 2.20 time: 1.225276 Jun 16 12:27:17.436152 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 42/76] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:27:16 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1407 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 12:27:17.466695 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-80b043c8-4b45-4a36-a04a-792c545438ee tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:17.467315 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-80b043c8-4b45-4a36-a04a-792c545438ee tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] [instance: c72b39de-9695-4833-8a7a-76af4eaa33d4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:17.498359 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-80b043c8-4b45-4a36-a04a-792c545438ee tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:17.498646 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-80b043c8-4b45-4a36-a04a-792c545438ee tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:17.519638 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-80b043c8-4b45-4a36-a04a-792c545438ee tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:17.521207 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-80b043c8-4b45-4a36-a04a-792c545438ee tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:17.759489 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-59817bd9-38a6-4ac5-a7a2-1ffc6dc4a0c0 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:17.791312 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-59817bd9-38a6-4ac5-a7a2-1ffc6dc4a0c0 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860" status: 200 len: 1321 microversion: 2.1 time: 0.621353 Jun 16 12:27:17.794393 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 35/77] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:17 2022] GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860 => generated 1321 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:17.816553 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-80b043c8-4b45-4a36-a04a-792c545438ee tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf22beda54e24b878e514304e7a62b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66000602298490b9e76d8138fdb825b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:17.823775 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-80b043c8-4b45-4a36-a04a-792c545438ee tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] 10.222.0.45 "GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4" status: 200 len: 1315 microversion: 2.1 time: 0.385237 Jun 16 12:27:17.827363 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 43/78] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:17 2022] GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4 => generated 1315 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:17.892258 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-25d8798d-701e-405a-841e-755adca8a2af req-0d6271e6-d905-438d-84a6-bb92edc47945 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8528919e-1e7a-4807-9b11-ae225e65d4df", "name": "network-vif-plugged", "status": "completed", "tag": "ee66a439-1483-44c8-a66e-9b4920bb00e9"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:27:17.913992 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-25d8798d-701e-405a-841e-755adca8a2af req-0d6271e6-d905-438d-84a6-bb92edc47945 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:17.914505 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-25d8798d-701e-405a-841e-755adca8a2af req-0d6271e6-d905-438d-84a6-bb92edc47945 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:17.944637 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-25d8798d-701e-405a-841e-755adca8a2af req-0d6271e6-d905-438d-84a6-bb92edc47945 service nova] Creating event network-vif-plugged:ee66a439-1483-44c8-a66e-9b4920bb00e9 for instance 8528919e-1e7a-4807-9b11-ae225e65d4df on hv-cinder-84614 Jun 16 12:27:17.957081 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-25d8798d-701e-405a-841e-755adca8a2af req-0d6271e6-d905-438d-84a6-bb92edc47945 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070751 Jun 16 12:27:17.962761 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 36/79] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:27:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:27:18.043500 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7db0c7c1-cfd3-4247-9c65-e761d33bab0b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:18.045377 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7db0c7c1-cfd3-4247-9c65-e761d33bab0b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: ddba5ba6-d9f4-493c-b15b-9443a5426682] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:18.060842 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7db0c7c1-cfd3-4247-9c65-e761d33bab0b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:18.061636 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7db0c7c1-cfd3-4247-9c65-e761d33bab0b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:18.062992 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7db0c7c1-cfd3-4247-9c65-e761d33bab0b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:18.063467 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7db0c7c1-cfd3-4247-9c65-e761d33bab0b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:18.259671 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7db0c7c1-cfd3-4247-9c65-e761d33bab0b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:18.268435 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7db0c7c1-cfd3-4247-9c65-e761d33bab0b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682" status: 200 len: 1365 microversion: 2.1 time: 0.231955 Jun 16 12:27:18.269002 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 44/80] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:18 2022] GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682 => generated 1365 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:18.457287 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-24c83565-7c02-45b4-b5e8-fb4a84e41112 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:18.458403 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-24c83565-7c02-45b4-b5e8-fb4a84e41112 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:18.469122 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-24c83565-7c02-45b4-b5e8-fb4a84e41112 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:18.470589 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-24c83565-7c02-45b4-b5e8-fb4a84e41112 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:18.472471 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-24c83565-7c02-45b4-b5e8-fb4a84e41112 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:18.472915 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-24c83565-7c02-45b4-b5e8-fb4a84e41112 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:18.753438 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-24c83565-7c02-45b4-b5e8-fb4a84e41112 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:18.766401 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-24c83565-7c02-45b4-b5e8-fb4a84e41112 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:18.770337 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-24c83565-7c02-45b4-b5e8-fb4a84e41112 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:18.773093 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-24c83565-7c02-45b4-b5e8-fb4a84e41112 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1407 microversion: 2.20 time: 0.323865 Jun 16 12:27:18.791888 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 37/81] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:27:18 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1407 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:27:18.812501 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-17238992-47db-4a06-8e58-3489977b828e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:18.813277 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-17238992-47db-4a06-8e58-3489977b828e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: 331b2de0-3963-4186-bc19-f2fe2e97d860] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:18.826712 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-17238992-47db-4a06-8e58-3489977b828e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:18.826712 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-17238992-47db-4a06-8e58-3489977b828e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:18.826712 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-17238992-47db-4a06-8e58-3489977b828e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:18.826712 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-17238992-47db-4a06-8e58-3489977b828e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:18.845796 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f61bac06-fa3a-4ed3-a7fc-3735b4b2d856 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:18.846704 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f61bac06-fa3a-4ed3-a7fc-3735b4b2d856 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] [instance: c72b39de-9695-4833-8a7a-76af4eaa33d4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:18.857478 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f61bac06-fa3a-4ed3-a7fc-3735b4b2d856 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:18.859851 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f61bac06-fa3a-4ed3-a7fc-3735b4b2d856 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:18.863411 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f61bac06-fa3a-4ed3-a7fc-3735b4b2d856 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:18.864574 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f61bac06-fa3a-4ed3-a7fc-3735b4b2d856 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:19.140842 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-17238992-47db-4a06-8e58-3489977b828e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:19.151154 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f61bac06-fa3a-4ed3-a7fc-3735b4b2d856 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf22beda54e24b878e514304e7a62b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66000602298490b9e76d8138fdb825b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:19.161738 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-17238992-47db-4a06-8e58-3489977b828e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860" status: 200 len: 1321 microversion: 2.1 time: 0.354595 Jun 16 12:27:19.164058 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f61bac06-fa3a-4ed3-a7fc-3735b4b2d856 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] 10.222.0.45 "GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4" status: 200 len: 1315 microversion: 2.1 time: 0.323555 Jun 16 12:27:19.165140 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 38/82] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:18 2022] GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4 => generated 1315 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:27:19.177971 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 45/83] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:18 2022] GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860 => generated 1321 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:19.286437 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b6e66709-e95b-48d5-a9e1-6f5461e253b5 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:19.287440 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b6e66709-e95b-48d5-a9e1-6f5461e253b5 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: ddba5ba6-d9f4-493c-b15b-9443a5426682] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:19.295466 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b6e66709-e95b-48d5-a9e1-6f5461e253b5 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:19.296155 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b6e66709-e95b-48d5-a9e1-6f5461e253b5 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:19.297092 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b6e66709-e95b-48d5-a9e1-6f5461e253b5 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:19.297836 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b6e66709-e95b-48d5-a9e1-6f5461e253b5 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:19.576971 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b6e66709-e95b-48d5-a9e1-6f5461e253b5 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:19.586264 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b6e66709-e95b-48d5-a9e1-6f5461e253b5 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682" status: 200 len: 1365 microversion: 2.1 time: 0.303376 Jun 16 12:27:19.587174 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 39/84] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:19 2022] GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682 => generated 1365 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:19.806067 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-71deba09-cd15-4c31-85cf-eb2642703f26 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:19.806813 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-71deba09-cd15-4c31-85cf-eb2642703f26 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:19.813614 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-71deba09-cd15-4c31-85cf-eb2642703f26 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:19.814434 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-71deba09-cd15-4c31-85cf-eb2642703f26 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:19.815158 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-71deba09-cd15-4c31-85cf-eb2642703f26 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:19.815600 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-71deba09-cd15-4c31-85cf-eb2642703f26 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:19.976365 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-232b36f7-d27d-4ca2-bbca-5e218f7f62d6 req-16e0d7f1-cb4d-478d-b731-7d4d25908aba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7405152-1807-4b2a-8701-ef2b2a8cbafb", "name": "network-vif-plugged", "status": "completed", "tag": "e3f227d9-42cf-4cc8-b18b-eeba97dbf2ba"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:27:19.986289 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-232b36f7-d27d-4ca2-bbca-5e218f7f62d6 req-16e0d7f1-cb4d-478d-b731-7d4d25908aba service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:19.987768 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-232b36f7-d27d-4ca2-bbca-5e218f7f62d6 req-16e0d7f1-cb4d-478d-b731-7d4d25908aba service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:19.998813 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-71deba09-cd15-4c31-85cf-eb2642703f26 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:20.007965 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-71deba09-cd15-4c31-85cf-eb2642703f26 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:20.010113 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-71deba09-cd15-4c31-85cf-eb2642703f26 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:20.011757 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-71deba09-cd15-4c31-85cf-eb2642703f26 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1407 microversion: 2.20 time: 0.216379 Jun 16 12:27:20.014079 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-232b36f7-d27d-4ca2-bbca-5e218f7f62d6 req-16e0d7f1-cb4d-478d-b731-7d4d25908aba service nova] Creating event network-vif-plugged:e3f227d9-42cf-4cc8-b18b-eeba97dbf2ba for instance c7405152-1807-4b2a-8701-ef2b2a8cbafb on hv-cinder-84614 Jun 16 12:27:20.024292 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 46/85] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:27:19 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1407 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:27:20.027000 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-232b36f7-d27d-4ca2-bbca-5e218f7f62d6 req-16e0d7f1-cb4d-478d-b731-7d4d25908aba service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055115 Jun 16 12:27:20.028004 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 40/86] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:27:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:27:20.182702 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-455dd09f-9023-42ee-8ec4-81e6d6b01a59 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:20.184259 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-455dd09f-9023-42ee-8ec4-81e6d6b01a59 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] [instance: c72b39de-9695-4833-8a7a-76af4eaa33d4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:20.186816 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-040dae0f-6244-4152-99c2-381854135a95 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:20.188440 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-040dae0f-6244-4152-99c2-381854135a95 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: 331b2de0-3963-4186-bc19-f2fe2e97d860] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:20.191840 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-455dd09f-9023-42ee-8ec4-81e6d6b01a59 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:20.192358 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-455dd09f-9023-42ee-8ec4-81e6d6b01a59 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:20.193349 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-455dd09f-9023-42ee-8ec4-81e6d6b01a59 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:20.194055 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-455dd09f-9023-42ee-8ec4-81e6d6b01a59 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:20.196600 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-040dae0f-6244-4152-99c2-381854135a95 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:20.197208 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-040dae0f-6244-4152-99c2-381854135a95 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:20.198198 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-040dae0f-6244-4152-99c2-381854135a95 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:20.199081 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-040dae0f-6244-4152-99c2-381854135a95 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:20.672978 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-040dae0f-6244-4152-99c2-381854135a95 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:20.684280 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-455dd09f-9023-42ee-8ec4-81e6d6b01a59 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf22beda54e24b878e514304e7a62b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66000602298490b9e76d8138fdb825b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:20.702064 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-040dae0f-6244-4152-99c2-381854135a95 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860" status: 200 len: 1321 microversion: 2.1 time: 0.514034 Jun 16 12:27:20.702217 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-455dd09f-9023-42ee-8ec4-81e6d6b01a59 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] 10.222.0.45 "GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4" status: 200 len: 1315 microversion: 2.1 time: 0.518299 Jun 16 12:27:20.702304 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 41/87] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:20 2022] GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860 => generated 1321 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:27:20.702381 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 47/88] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:20 2022] GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4 => generated 1315 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:20.702936 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1614831c-3d6f-4c22-ab54-e39beee9c90d tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:20.703553 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1614831c-3d6f-4c22-ab54-e39beee9c90d tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: ddba5ba6-d9f4-493c-b15b-9443a5426682] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:20.711088 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1614831c-3d6f-4c22-ab54-e39beee9c90d tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:20.712027 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1614831c-3d6f-4c22-ab54-e39beee9c90d tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:20.713615 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1614831c-3d6f-4c22-ab54-e39beee9c90d tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:20.714399 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1614831c-3d6f-4c22-ab54-e39beee9c90d tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:21.039774 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-37e9e26a-609e-4af2-b0a9-884c1fdb4cb6 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:21.050761 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-37e9e26a-609e-4af2-b0a9-884c1fdb4cb6 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:21.078049 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-37e9e26a-609e-4af2-b0a9-884c1fdb4cb6 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:21.080770 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-37e9e26a-609e-4af2-b0a9-884c1fdb4cb6 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:21.086275 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-37e9e26a-609e-4af2-b0a9-884c1fdb4cb6 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:21.088561 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-37e9e26a-609e-4af2-b0a9-884c1fdb4cb6 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:21.506713 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1614831c-3d6f-4c22-ab54-e39beee9c90d tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:21.520328 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1614831c-3d6f-4c22-ab54-e39beee9c90d tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682" status: 200 len: 1365 microversion: 2.1 time: 0.821489 Jun 16 12:27:21.521833 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 42/89] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:20 2022] GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682 => generated 1365 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:21.572099 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-37e9e26a-609e-4af2-b0a9-884c1fdb4cb6 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:21.583779 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-37e9e26a-609e-4af2-b0a9-884c1fdb4cb6 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:21.585895 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-37e9e26a-609e-4af2-b0a9-884c1fdb4cb6 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:21.587380 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-37e9e26a-609e-4af2-b0a9-884c1fdb4cb6 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1407 microversion: 2.20 time: 0.559497 Jun 16 12:27:21.588330 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 48/90] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:27:21 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1407 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:27:21.712813 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f8862bd9-0aab-4911-8582-f9f3f4b809ae tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:21.713411 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f8862bd9-0aab-4911-8582-f9f3f4b809ae tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: 331b2de0-3963-4186-bc19-f2fe2e97d860] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:21.718516 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-96bcf115-88f7-4876-b0a1-82982b9c0a15 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:21.719603 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-96bcf115-88f7-4876-b0a1-82982b9c0a15 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] [instance: c72b39de-9695-4833-8a7a-76af4eaa33d4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:21.720614 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f8862bd9-0aab-4911-8582-f9f3f4b809ae tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:21.721263 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f8862bd9-0aab-4911-8582-f9f3f4b809ae tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:21.722142 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f8862bd9-0aab-4911-8582-f9f3f4b809ae tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:21.722642 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f8862bd9-0aab-4911-8582-f9f3f4b809ae tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:21.726831 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-96bcf115-88f7-4876-b0a1-82982b9c0a15 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:21.727493 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-96bcf115-88f7-4876-b0a1-82982b9c0a15 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:21.728776 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-96bcf115-88f7-4876-b0a1-82982b9c0a15 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:21.729378 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-96bcf115-88f7-4876-b0a1-82982b9c0a15 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:21.930850 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f8862bd9-0aab-4911-8582-f9f3f4b809ae tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:21.934762 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-96bcf115-88f7-4876-b0a1-82982b9c0a15 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf22beda54e24b878e514304e7a62b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66000602298490b9e76d8138fdb825b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:21.938754 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f8862bd9-0aab-4911-8582-f9f3f4b809ae tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860" status: 200 len: 1321 microversion: 2.1 time: 0.229956 Jun 16 12:27:21.939329 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 43/91] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:21 2022] GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860 => generated 1321 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:21.942213 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-96bcf115-88f7-4876-b0a1-82982b9c0a15 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] 10.222.0.45 "GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4" status: 200 len: 1315 microversion: 2.1 time: 0.229481 Jun 16 12:27:21.943057 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 49/92] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:21 2022] GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4 => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:22.538703 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-9ce513f2-667f-4370-a808-4949983eb8a2 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:22.539315 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-9ce513f2-667f-4370-a808-4949983eb8a2 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: ddba5ba6-d9f4-493c-b15b-9443a5426682] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:22.545631 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9ce513f2-667f-4370-a808-4949983eb8a2 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:22.546111 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9ce513f2-667f-4370-a808-4949983eb8a2 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:22.546871 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9ce513f2-667f-4370-a808-4949983eb8a2 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:22.547304 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9ce513f2-667f-4370-a808-4949983eb8a2 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:22.605379 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-53123207-85f9-4665-a568-45f3e26fdd2b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:22.606271 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-53123207-85f9-4665-a568-45f3e26fdd2b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:22.612597 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-53123207-85f9-4665-a568-45f3e26fdd2b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:22.613051 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-53123207-85f9-4665-a568-45f3e26fdd2b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:22.613820 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-53123207-85f9-4665-a568-45f3e26fdd2b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:22.614277 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-53123207-85f9-4665-a568-45f3e26fdd2b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:22.737201 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-9ce513f2-667f-4370-a808-4949983eb8a2 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:22.755231 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-9ce513f2-667f-4370-a808-4949983eb8a2 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682" status: 200 len: 1365 microversion: 2.1 time: 0.220450 Jun 16 12:27:22.755855 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 44/93] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:22 2022] GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682 => generated 1365 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:22.790393 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-53123207-85f9-4665-a568-45f3e26fdd2b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:22.799857 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-53123207-85f9-4665-a568-45f3e26fdd2b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:22.801488 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-53123207-85f9-4665-a568-45f3e26fdd2b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:22.802698 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-53123207-85f9-4665-a568-45f3e26fdd2b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1407 microversion: 2.20 time: 0.201360 Jun 16 12:27:22.803653 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 50/94] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:27:22 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1407 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 12:27:22.956693 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b9af16dc-3b07-4159-95a9-c9c2e5d10df8 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:22.957301 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b9af16dc-3b07-4159-95a9-c9c2e5d10df8 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: 331b2de0-3963-4186-bc19-f2fe2e97d860] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:22.959083 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6f4ee6f9-701d-47d8-b809-bc057faf9ce4 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:22.959672 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6f4ee6f9-701d-47d8-b809-bc057faf9ce4 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] [instance: c72b39de-9695-4833-8a7a-76af4eaa33d4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:22.964564 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b9af16dc-3b07-4159-95a9-c9c2e5d10df8 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:22.965018 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b9af16dc-3b07-4159-95a9-c9c2e5d10df8 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:22.966383 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b9af16dc-3b07-4159-95a9-c9c2e5d10df8 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:22.966940 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b9af16dc-3b07-4159-95a9-c9c2e5d10df8 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:22.967040 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6f4ee6f9-701d-47d8-b809-bc057faf9ce4 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:22.967438 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6f4ee6f9-701d-47d8-b809-bc057faf9ce4 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:22.968258 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6f4ee6f9-701d-47d8-b809-bc057faf9ce4 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:22.968701 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6f4ee6f9-701d-47d8-b809-bc057faf9ce4 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:23.163805 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b9af16dc-3b07-4159-95a9-c9c2e5d10df8 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:23.167578 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6f4ee6f9-701d-47d8-b809-bc057faf9ce4 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf22beda54e24b878e514304e7a62b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66000602298490b9e76d8138fdb825b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:23.172767 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b9af16dc-3b07-4159-95a9-c9c2e5d10df8 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860" status: 200 len: 1321 microversion: 2.1 time: 0.220338 Jun 16 12:27:23.173345 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 45/95] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:22 2022] GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860 => generated 1321 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:23.176508 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6f4ee6f9-701d-47d8-b809-bc057faf9ce4 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] 10.222.0.45 "GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4" status: 200 len: 1315 microversion: 2.1 time: 0.221198 Jun 16 12:27:23.177070 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 51/96] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:22 2022] GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4 => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:23.771892 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1863f676-291c-47cf-ad2a-0acf717bb425 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:23.772498 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1863f676-291c-47cf-ad2a-0acf717bb425 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: ddba5ba6-d9f4-493c-b15b-9443a5426682] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:23.778595 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1863f676-291c-47cf-ad2a-0acf717bb425 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:23.778944 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1863f676-291c-47cf-ad2a-0acf717bb425 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:23.779699 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1863f676-291c-47cf-ad2a-0acf717bb425 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:23.780125 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1863f676-291c-47cf-ad2a-0acf717bb425 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:23.822159 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-995d62d3-fef4-4ac4-aec7-5d738d894227 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:23.822768 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-995d62d3-fef4-4ac4-aec7-5d738d894227 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:23.829976 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-995d62d3-fef4-4ac4-aec7-5d738d894227 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:23.830428 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-995d62d3-fef4-4ac4-aec7-5d738d894227 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:23.831183 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-995d62d3-fef4-4ac4-aec7-5d738d894227 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:23.831617 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-995d62d3-fef4-4ac4-aec7-5d738d894227 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:23.960882 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1863f676-291c-47cf-ad2a-0acf717bb425 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:23.964803 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell0:SELECT=2 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:23.973630 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1863f676-291c-47cf-ad2a-0acf717bb425 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682" status: 200 len: 1365 microversion: 2.1 time: 0.204894 Jun 16 12:27:23.974021 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 46/97] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:23 2022] GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682 => generated 1365 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:23.990637 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-995d62d3-fef4-4ac4-aec7-5d738d894227 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:24.000875 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-995d62d3-fef4-4ac4-aec7-5d738d894227 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:24.002413 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-995d62d3-fef4-4ac4-aec7-5d738d894227 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:24.003849 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-995d62d3-fef4-4ac4-aec7-5d738d894227 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1407 microversion: 2.20 time: 0.185622 Jun 16 12:27:24.004399 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 52/98] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:27:23 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1407 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 12:27:24.190147 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a64a4f1e-03ba-4824-a722-3f1da8702ed1 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:24.190752 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a64a4f1e-03ba-4824-a722-3f1da8702ed1 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: 331b2de0-3963-4186-bc19-f2fe2e97d860] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:24.192364 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-40fdd27a-212b-400b-97f3-1d0be451ec4c tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:24.193011 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-40fdd27a-212b-400b-97f3-1d0be451ec4c tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] [instance: c72b39de-9695-4833-8a7a-76af4eaa33d4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:24.196843 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a64a4f1e-03ba-4824-a722-3f1da8702ed1 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:24.197291 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a64a4f1e-03ba-4824-a722-3f1da8702ed1 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:24.198076 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a64a4f1e-03ba-4824-a722-3f1da8702ed1 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:24.198506 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a64a4f1e-03ba-4824-a722-3f1da8702ed1 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:24.203213 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-40fdd27a-212b-400b-97f3-1d0be451ec4c tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:24.203667 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-40fdd27a-212b-400b-97f3-1d0be451ec4c tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:24.204436 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-40fdd27a-212b-400b-97f3-1d0be451ec4c tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:24.204869 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-40fdd27a-212b-400b-97f3-1d0be451ec4c tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:24.232858 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:24.412288 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-40fdd27a-212b-400b-97f3-1d0be451ec4c tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf22beda54e24b878e514304e7a62b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66000602298490b9e76d8138fdb825b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:24.412402 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a64a4f1e-03ba-4824-a722-3f1da8702ed1 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:24.426651 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a64a4f1e-03ba-4824-a722-3f1da8702ed1 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860" status: 200 len: 1321 microversion: 2.1 time: 0.240360 Jun 16 12:27:24.427829 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-40fdd27a-212b-400b-97f3-1d0be451ec4c tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] 10.222.0.45 "GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4" status: 200 len: 1315 microversion: 2.1 time: 0.239168 Jun 16 12:27:24.428469 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 47/99] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:24 2022] GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860 => generated 1321 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:24.428981 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 53/100] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:24 2022] GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4 => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:27:24.989840 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0efcbd16-9012-4c04-9676-041b725314dd tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:24.990471 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0efcbd16-9012-4c04-9676-041b725314dd tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: ddba5ba6-d9f4-493c-b15b-9443a5426682] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:24.996978 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0efcbd16-9012-4c04-9676-041b725314dd tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:24.997428 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0efcbd16-9012-4c04-9676-041b725314dd tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:24.998206 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0efcbd16-9012-4c04-9676-041b725314dd tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:24.998635 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0efcbd16-9012-4c04-9676-041b725314dd tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:25.022003 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-353daceb-df70-489a-b15b-0bab876161f8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:25.022617 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-353daceb-df70-489a-b15b-0bab876161f8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:25.028768 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-353daceb-df70-489a-b15b-0bab876161f8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:25.029223 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-353daceb-df70-489a-b15b-0bab876161f8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:25.030020 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-353daceb-df70-489a-b15b-0bab876161f8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:25.030461 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-353daceb-df70-489a-b15b-0bab876161f8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:25.189011 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0efcbd16-9012-4c04-9676-041b725314dd tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:25.196325 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0efcbd16-9012-4c04-9676-041b725314dd tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682" status: 200 len: 1365 microversion: 2.1 time: 0.210304 Jun 16 12:27:25.196889 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 48/101] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:24 2022] GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682 => generated 1365 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:25.213458 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-353daceb-df70-489a-b15b-0bab876161f8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:25.221330 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-353daceb-df70-489a-b15b-0bab876161f8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:25.222859 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-353daceb-df70-489a-b15b-0bab876161f8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:25.224295 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-353daceb-df70-489a-b15b-0bab876161f8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1407 microversion: 2.20 time: 0.205806 Jun 16 12:27:25.224500 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 54/102] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:27:25 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1407 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 12:27:25.445566 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-208c8e7c-65dd-4aa8-b635-3d1135656b09 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:25.445725 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6973b799-dc95-4645-8a47-e6bdc4bda8a6 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:25.446349 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-208c8e7c-65dd-4aa8-b635-3d1135656b09 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: 331b2de0-3963-4186-bc19-f2fe2e97d860] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:25.446498 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6973b799-dc95-4645-8a47-e6bdc4bda8a6 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] [instance: c72b39de-9695-4833-8a7a-76af4eaa33d4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:25.453603 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6973b799-dc95-4645-8a47-e6bdc4bda8a6 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:25.453739 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-208c8e7c-65dd-4aa8-b635-3d1135656b09 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:25.454084 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6973b799-dc95-4645-8a47-e6bdc4bda8a6 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:25.454347 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-208c8e7c-65dd-4aa8-b635-3d1135656b09 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:25.454869 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6973b799-dc95-4645-8a47-e6bdc4bda8a6 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:25.455260 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-208c8e7c-65dd-4aa8-b635-3d1135656b09 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:25.455364 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6973b799-dc95-4645-8a47-e6bdc4bda8a6 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:25.455826 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-208c8e7c-65dd-4aa8-b635-3d1135656b09 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:25.853247 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6973b799-dc95-4645-8a47-e6bdc4bda8a6 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf22beda54e24b878e514304e7a62b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66000602298490b9e76d8138fdb825b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:25.856713 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-208c8e7c-65dd-4aa8-b635-3d1135656b09 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:25.874876 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6973b799-dc95-4645-8a47-e6bdc4bda8a6 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] 10.222.0.45 "GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4" status: 200 len: 1315 microversion: 2.1 time: 0.432914 Jun 16 12:27:25.875469 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 49/103] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:25 2022] GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4 => generated 1315 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:25.883068 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-208c8e7c-65dd-4aa8-b635-3d1135656b09 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860" status: 200 len: 1321 microversion: 2.1 time: 0.441382 Jun 16 12:27:25.883646 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 55/104] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:25 2022] GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860 => generated 1321 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:27:26.213634 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b136cfb7-ab63-4108-a8f9-c7e6d05ed55b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:26.214387 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b136cfb7-ab63-4108-a8f9-c7e6d05ed55b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: ddba5ba6-d9f4-493c-b15b-9443a5426682] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:26.220414 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b136cfb7-ab63-4108-a8f9-c7e6d05ed55b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:26.220862 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b136cfb7-ab63-4108-a8f9-c7e6d05ed55b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:26.221614 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b136cfb7-ab63-4108-a8f9-c7e6d05ed55b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:26.222073 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b136cfb7-ab63-4108-a8f9-c7e6d05ed55b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:26.241421 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-da2c3545-c5f9-4f81-a439-ac45fd7972a7 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:26.242167 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-da2c3545-c5f9-4f81-a439-ac45fd7972a7 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:26.249166 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-da2c3545-c5f9-4f81-a439-ac45fd7972a7 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:26.249684 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-da2c3545-c5f9-4f81-a439-ac45fd7972a7 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:26.250537 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-da2c3545-c5f9-4f81-a439-ac45fd7972a7 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:26.255584 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-da2c3545-c5f9-4f81-a439-ac45fd7972a7 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:26.408610 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b136cfb7-ab63-4108-a8f9-c7e6d05ed55b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:26.416455 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b136cfb7-ab63-4108-a8f9-c7e6d05ed55b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682" status: 200 len: 1365 microversion: 2.1 time: 0.206561 Jun 16 12:27:26.417134 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 50/105] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:26 2022] GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682 => generated 1365 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:26.442867 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-da2c3545-c5f9-4f81-a439-ac45fd7972a7 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:26.451279 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-da2c3545-c5f9-4f81-a439-ac45fd7972a7 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:26.452777 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-da2c3545-c5f9-4f81-a439-ac45fd7972a7 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:26.453955 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-da2c3545-c5f9-4f81-a439-ac45fd7972a7 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1407 microversion: 2.20 time: 0.216769 Jun 16 12:27:26.454580 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 56/106] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:27:26 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1407 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 12:27:26.891934 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8ef96ecf-38a0-426a-ab35-22810bdf4258 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:26.892703 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8ef96ecf-38a0-426a-ab35-22810bdf4258 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] [instance: c72b39de-9695-4833-8a7a-76af4eaa33d4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:26.898932 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8ef96ecf-38a0-426a-ab35-22810bdf4258 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:26.899409 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8ef96ecf-38a0-426a-ab35-22810bdf4258 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:26.900205 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8ef96ecf-38a0-426a-ab35-22810bdf4258 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:26.900666 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8ef96ecf-38a0-426a-ab35-22810bdf4258 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:26.901627 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-54b46540-908e-494e-9357-3259102afdff tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:26.903345 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-54b46540-908e-494e-9357-3259102afdff tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: 331b2de0-3963-4186-bc19-f2fe2e97d860] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:26.904224 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:26.910600 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-54b46540-908e-494e-9357-3259102afdff tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:26.911452 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-54b46540-908e-494e-9357-3259102afdff tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:26.912315 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-54b46540-908e-494e-9357-3259102afdff tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:26.912987 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-54b46540-908e-494e-9357-3259102afdff tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:27.140459 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8ef96ecf-38a0-426a-ab35-22810bdf4258 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf22beda54e24b878e514304e7a62b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66000602298490b9e76d8138fdb825b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:27.142913 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-54b46540-908e-494e-9357-3259102afdff tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:27.149404 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8ef96ecf-38a0-426a-ab35-22810bdf4258 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] 10.222.0.45 "GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4" status: 200 len: 1315 microversion: 2.1 time: 0.261114 Jun 16 12:27:27.150660 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 51/107] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:26 2022] GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4 => generated 1315 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:27.160366 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-54b46540-908e-494e-9357-3259102afdff tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860" status: 200 len: 1515 microversion: 2.1 time: 0.263587 Jun 16 12:27:27.161308 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 57/108] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:26 2022] GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860 => generated 1515 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:27:27.178588 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7490924f-d06e-4c82-b1d1-6b4f44412998 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:27:27.179865 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7490924f-d06e-4c82-b1d1-6b4f44412998 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: 331b2de0-3963-4186-bc19-f2fe2e97d860] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:27.205797 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7490924f-d06e-4c82-b1d1-6b4f44412998 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:27.209447 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7490924f-d06e-4c82-b1d1-6b4f44412998 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:27.211562 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7490924f-d06e-4c82-b1d1-6b4f44412998 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:27.212220 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7490924f-d06e-4c82-b1d1-6b4f44412998 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:27.291017 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.objects.instance [None req-7490924f-d06e-4c82-b1d1-6b4f44412998 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lazy-loading 'flavor' on Instance uuid 331b2de0-3963-4186-bc19-f2fe2e97d860 {{(pid=117607) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 12:27:27.434912 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e4b0904c-ed6b-45d8-b805-d61796f88df1 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:27.436246 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e4b0904c-ed6b-45d8-b805-d61796f88df1 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: ddba5ba6-d9f4-493c-b15b-9443a5426682] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:27.442851 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e4b0904c-ed6b-45d8-b805-d61796f88df1 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:27.443482 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e4b0904c-ed6b-45d8-b805-d61796f88df1 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:27.444436 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e4b0904c-ed6b-45d8-b805-d61796f88df1 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:27.445022 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e4b0904c-ed6b-45d8-b805-d61796f88df1 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:27.454478 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7490924f-d06e-4c82-b1d1-6b4f44412998 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "POST /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860/action" status: 200 len: 32 microversion: 2.1 time: 0.279254 Jun 16 12:27:27.455594 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 52/109] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Jun 16 12:27:27 2022] POST /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860/action => generated 32 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 12:27:27.468274 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5178e015-2159-4aa5-9f23-e1ea0e4760ef tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:27.469254 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5178e015-2159-4aa5-9f23-e1ea0e4760ef tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: 331b2de0-3963-4186-bc19-f2fe2e97d860] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:27.477906 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5178e015-2159-4aa5-9f23-e1ea0e4760ef tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:27.478433 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5178e015-2159-4aa5-9f23-e1ea0e4760ef tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:27.480572 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5178e015-2159-4aa5-9f23-e1ea0e4760ef tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:27.482067 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5178e015-2159-4aa5-9f23-e1ea0e4760ef tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:27.867305 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e4b0904c-ed6b-45d8-b805-d61796f88df1 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:27.892515 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e4b0904c-ed6b-45d8-b805-d61796f88df1 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682" status: 200 len: 1365 microversion: 2.1 time: 0.462220 Jun 16 12:27:27.893601 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 58/110] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:27 2022] GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682 => generated 1365 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:27:27.898894 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1fd2d740-075c-4835-9dd8-0397c7504162 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:27.899755 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1fd2d740-075c-4835-9dd8-0397c7504162 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:27.908802 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1fd2d740-075c-4835-9dd8-0397c7504162 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:27.909690 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1fd2d740-075c-4835-9dd8-0397c7504162 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:27.910716 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1fd2d740-075c-4835-9dd8-0397c7504162 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:27.911550 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1fd2d740-075c-4835-9dd8-0397c7504162 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:27.934818 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5178e015-2159-4aa5-9f23-e1ea0e4760ef tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:27.946617 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5178e015-2159-4aa5-9f23-e1ea0e4760ef tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860" status: 200 len: 1521 microversion: 2.1 time: 0.485731 Jun 16 12:27:27.947220 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 53/111] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:27 2022] GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860 => generated 1521 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:28.109443 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1fd2d740-075c-4835-9dd8-0397c7504162 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:28.119615 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1fd2d740-075c-4835-9dd8-0397c7504162 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:28.121046 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1fd2d740-075c-4835-9dd8-0397c7504162 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:28.123282 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1fd2d740-075c-4835-9dd8-0397c7504162 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1407 microversion: 2.20 time: 0.228477 Jun 16 12:27:28.126632 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 59/112] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:27:27 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1407 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:27:28.167850 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a3dc2dd8-397d-45c4-a656-86a3e3297855 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:28.168737 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a3dc2dd8-397d-45c4-a656-86a3e3297855 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] [instance: c72b39de-9695-4833-8a7a-76af4eaa33d4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:28.176367 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a3dc2dd8-397d-45c4-a656-86a3e3297855 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:28.176982 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a3dc2dd8-397d-45c4-a656-86a3e3297855 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:28.177974 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a3dc2dd8-397d-45c4-a656-86a3e3297855 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:28.178409 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a3dc2dd8-397d-45c4-a656-86a3e3297855 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:28.277404 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-36d9c55b-7193-487d-9d25-c344c1b9ac6c req-0ed70804-b658-4475-b7ff-6109dda754b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddba5ba6-d9f4-493c-b15b-9443a5426682", "name": "network-vif-plugged", "status": "completed", "tag": "80765d24-d4d2-42f5-b6b1-6bb0e8d83b1d"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:27:28.308889 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-36d9c55b-7193-487d-9d25-c344c1b9ac6c req-0ed70804-b658-4475-b7ff-6109dda754b6 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:28.309821 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-36d9c55b-7193-487d-9d25-c344c1b9ac6c req-0ed70804-b658-4475-b7ff-6109dda754b6 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:28.332109 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-36d9c55b-7193-487d-9d25-c344c1b9ac6c req-0ed70804-b658-4475-b7ff-6109dda754b6 service nova] Creating event network-vif-plugged:80765d24-d4d2-42f5-b6b1-6bb0e8d83b1d for instance ddba5ba6-d9f4-493c-b15b-9443a5426682 on hv-cinder-84614 Jun 16 12:27:28.354094 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a3dc2dd8-397d-45c4-a656-86a3e3297855 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf22beda54e24b878e514304e7a62b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66000602298490b9e76d8138fdb825b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:28.364509 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a3dc2dd8-397d-45c4-a656-86a3e3297855 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] 10.222.0.45 "GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4" status: 200 len: 1315 microversion: 2.1 time: 0.200826 Jun 16 12:27:28.367428 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 54/113] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:28 2022] GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4 => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:28.368246 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-36d9c55b-7193-487d-9d25-c344c1b9ac6c req-0ed70804-b658-4475-b7ff-6109dda754b6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092798 Jun 16 12:27:28.368979 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 60/114] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:27:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 12:27:28.909219 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a72f8d29-fbff-41ce-919e-9a1e711e7810 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:28.909924 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a72f8d29-fbff-41ce-919e-9a1e711e7810 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: ddba5ba6-d9f4-493c-b15b-9443a5426682] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:28.916755 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a72f8d29-fbff-41ce-919e-9a1e711e7810 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:28.917209 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a72f8d29-fbff-41ce-919e-9a1e711e7810 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:28.918081 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a72f8d29-fbff-41ce-919e-9a1e711e7810 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:28.919170 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a72f8d29-fbff-41ce-919e-9a1e711e7810 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:28.970394 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d7f3de10-db4b-48d2-b95c-6e622fa96101 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:28.971318 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d7f3de10-db4b-48d2-b95c-6e622fa96101 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: 331b2de0-3963-4186-bc19-f2fe2e97d860] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:28.979053 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d7f3de10-db4b-48d2-b95c-6e622fa96101 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:28.979894 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d7f3de10-db4b-48d2-b95c-6e622fa96101 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:28.981164 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d7f3de10-db4b-48d2-b95c-6e622fa96101 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:28.981941 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d7f3de10-db4b-48d2-b95c-6e622fa96101 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:29.149112 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a72f8d29-fbff-41ce-919e-9a1e711e7810 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:29.160041 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a72f8d29-fbff-41ce-919e-9a1e711e7810 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682" status: 200 len: 1365 microversion: 2.1 time: 0.254357 Jun 16 12:27:29.161154 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 55/115] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:28 2022] GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682 => generated 1365 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:29.169128 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1f2dfa45-bffa-4dd0-acb3-50309162e4be tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:29.170660 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1f2dfa45-bffa-4dd0-acb3-50309162e4be tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:29.179158 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1f2dfa45-bffa-4dd0-acb3-50309162e4be tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:29.179813 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1f2dfa45-bffa-4dd0-acb3-50309162e4be tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:29.181398 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1f2dfa45-bffa-4dd0-acb3-50309162e4be tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:29.182261 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1f2dfa45-bffa-4dd0-acb3-50309162e4be tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:29.201447 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d7f3de10-db4b-48d2-b95c-6e622fa96101 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:29.210651 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d7f3de10-db4b-48d2-b95c-6e622fa96101 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860" status: 200 len: 1521 microversion: 2.1 time: 0.246579 Jun 16 12:27:29.211569 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 61/116] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:28 2022] GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860 => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:27:29.344685 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1f2dfa45-bffa-4dd0-acb3-50309162e4be tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:29.352877 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1f2dfa45-bffa-4dd0-acb3-50309162e4be tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:29.354412 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1f2dfa45-bffa-4dd0-acb3-50309162e4be tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:29.356734 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1f2dfa45-bffa-4dd0-acb3-50309162e4be tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1407 microversion: 2.20 time: 0.193495 Jun 16 12:27:29.357317 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 56/117] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:27:29 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:27:29.384267 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-92d925a8-9502-4737-a683-dd59fe537f74 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:29.384870 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-92d925a8-9502-4737-a683-dd59fe537f74 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] [instance: c72b39de-9695-4833-8a7a-76af4eaa33d4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:29.391909 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-92d925a8-9502-4737-a683-dd59fe537f74 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:29.392192 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-92d925a8-9502-4737-a683-dd59fe537f74 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:29.392923 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-92d925a8-9502-4737-a683-dd59fe537f74 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:29.393732 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-92d925a8-9502-4737-a683-dd59fe537f74 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:29.523432 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-92d925a8-9502-4737-a683-dd59fe537f74 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf22beda54e24b878e514304e7a62b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66000602298490b9e76d8138fdb825b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:29.531396 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-92d925a8-9502-4737-a683-dd59fe537f74 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] 10.222.0.45 "GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4" status: 200 len: 1315 microversion: 2.1 time: 0.150881 Jun 16 12:27:29.531967 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 62/118] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:29 2022] GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:30.177056 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-60877bea-598f-43fd-b1f9-87259a955201 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:30.177653 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-60877bea-598f-43fd-b1f9-87259a955201 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: ddba5ba6-d9f4-493c-b15b-9443a5426682] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:30.184037 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-60877bea-598f-43fd-b1f9-87259a955201 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:30.184570 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-60877bea-598f-43fd-b1f9-87259a955201 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:30.185329 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-60877bea-598f-43fd-b1f9-87259a955201 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:30.185760 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-60877bea-598f-43fd-b1f9-87259a955201 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:30.229556 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8a957d34-0f69-4884-8268-edee6ff7231e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:30.230630 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8a957d34-0f69-4884-8268-edee6ff7231e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: 331b2de0-3963-4186-bc19-f2fe2e97d860] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:30.236967 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8a957d34-0f69-4884-8268-edee6ff7231e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:30.237418 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8a957d34-0f69-4884-8268-edee6ff7231e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:30.238206 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8a957d34-0f69-4884-8268-edee6ff7231e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:30.238648 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8a957d34-0f69-4884-8268-edee6ff7231e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:30.370906 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-60877bea-598f-43fd-b1f9-87259a955201 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:30.378775 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-60877bea-598f-43fd-b1f9-87259a955201 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682" status: 200 len: 1365 microversion: 2.1 time: 0.205443 Jun 16 12:27:30.379343 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 57/119] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:30 2022] GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682 => generated 1365 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:30.383726 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-090635d4-04c1-4660-b139-f79e5bbc0053 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:30.384324 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-090635d4-04c1-4660-b139-f79e5bbc0053 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:30.390976 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-090635d4-04c1-4660-b139-f79e5bbc0053 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:30.391428 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-090635d4-04c1-4660-b139-f79e5bbc0053 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:30.392192 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-090635d4-04c1-4660-b139-f79e5bbc0053 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:30.392626 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-090635d4-04c1-4660-b139-f79e5bbc0053 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:30.401420 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8a957d34-0f69-4884-8268-edee6ff7231e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:30.409789 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8a957d34-0f69-4884-8268-edee6ff7231e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860" status: 200 len: 1521 microversion: 2.1 time: 0.185431 Jun 16 12:27:30.411166 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 63/120] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:30 2022] GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860 => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:27:30.520777 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-090635d4-04c1-4660-b139-f79e5bbc0053 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:30.528711 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-090635d4-04c1-4660-b139-f79e5bbc0053 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:30.530238 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-090635d4-04c1-4660-b139-f79e5bbc0053 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:30.531329 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-090635d4-04c1-4660-b139-f79e5bbc0053 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1407 microversion: 2.20 time: 0.151075 Jun 16 12:27:30.531888 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 58/121] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:27:30 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:27:30.548798 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8f0fe6ee-e34e-43f2-9429-2e4ea2612a78 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:30.549441 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8f0fe6ee-e34e-43f2-9429-2e4ea2612a78 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] [instance: c72b39de-9695-4833-8a7a-76af4eaa33d4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:30.555521 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8f0fe6ee-e34e-43f2-9429-2e4ea2612a78 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:30.555972 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8f0fe6ee-e34e-43f2-9429-2e4ea2612a78 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:30.556724 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8f0fe6ee-e34e-43f2-9429-2e4ea2612a78 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:30.557159 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8f0fe6ee-e34e-43f2-9429-2e4ea2612a78 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:30.687025 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8f0fe6ee-e34e-43f2-9429-2e4ea2612a78 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf22beda54e24b878e514304e7a62b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66000602298490b9e76d8138fdb825b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:30.694648 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8f0fe6ee-e34e-43f2-9429-2e4ea2612a78 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] 10.222.0.45 "GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4" status: 200 len: 1315 microversion: 2.1 time: 0.149662 Jun 16 12:27:30.695208 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 64/122] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:30 2022] GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:31.395600 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5cdbcddc-9042-474c-9d40-bd1b0b47d519 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:31.396209 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5cdbcddc-9042-474c-9d40-bd1b0b47d519 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: ddba5ba6-d9f4-493c-b15b-9443a5426682] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:31.402225 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5cdbcddc-9042-474c-9d40-bd1b0b47d519 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:31.402673 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5cdbcddc-9042-474c-9d40-bd1b0b47d519 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:31.404311 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5cdbcddc-9042-474c-9d40-bd1b0b47d519 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:31.404753 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5cdbcddc-9042-474c-9d40-bd1b0b47d519 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:31.427281 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-48f216e9-774b-4a61-9018-6943e47ae91d tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:31.427917 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-48f216e9-774b-4a61-9018-6943e47ae91d tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: 331b2de0-3963-4186-bc19-f2fe2e97d860] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:31.434070 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-48f216e9-774b-4a61-9018-6943e47ae91d tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:31.434606 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-48f216e9-774b-4a61-9018-6943e47ae91d tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:31.435424 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-48f216e9-774b-4a61-9018-6943e47ae91d tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:31.435864 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-48f216e9-774b-4a61-9018-6943e47ae91d tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:31.589914 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5cdbcddc-9042-474c-9d40-bd1b0b47d519 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:31.597922 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5cdbcddc-9042-474c-9d40-bd1b0b47d519 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682" status: 200 len: 1365 microversion: 2.1 time: 0.206125 Jun 16 12:27:31.598497 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 59/123] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:31 2022] GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682 => generated 1365 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:31.602874 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0a0ad884-f9bb-4934-bd30-dcbe3cc8eeb0 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:31.603656 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0a0ad884-f9bb-4934-bd30-dcbe3cc8eeb0 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:31.609372 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0a0ad884-f9bb-4934-bd30-dcbe3cc8eeb0 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:31.609987 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0a0ad884-f9bb-4934-bd30-dcbe3cc8eeb0 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:31.610615 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0a0ad884-f9bb-4934-bd30-dcbe3cc8eeb0 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:31.611049 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0a0ad884-f9bb-4934-bd30-dcbe3cc8eeb0 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:31.613826 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-48f216e9-774b-4a61-9018-6943e47ae91d tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:31.621349 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-48f216e9-774b-4a61-9018-6943e47ae91d tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860" status: 200 len: 1521 microversion: 2.1 time: 0.198164 Jun 16 12:27:31.622346 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 65/124] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:31 2022] GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860 => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:27:31.711358 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-24d08ec5-8b88-4b9e-b892-70415293085d tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:31.711919 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-24d08ec5-8b88-4b9e-b892-70415293085d tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] [instance: c72b39de-9695-4833-8a7a-76af4eaa33d4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:31.719130 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-24d08ec5-8b88-4b9e-b892-70415293085d tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:31.719578 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-24d08ec5-8b88-4b9e-b892-70415293085d tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:31.720332 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-24d08ec5-8b88-4b9e-b892-70415293085d tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:31.720762 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-24d08ec5-8b88-4b9e-b892-70415293085d tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:31.739381 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0a0ad884-f9bb-4934-bd30-dcbe3cc8eeb0 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:31.747831 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0a0ad884-f9bb-4934-bd30-dcbe3cc8eeb0 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:31.749433 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0a0ad884-f9bb-4934-bd30-dcbe3cc8eeb0 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:31.750635 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0a0ad884-f9bb-4934-bd30-dcbe3cc8eeb0 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1407 microversion: 2.20 time: 0.151228 Jun 16 12:27:31.751274 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 60/125] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:27:31 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:27:31.858235 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-24d08ec5-8b88-4b9e-b892-70415293085d tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf22beda54e24b878e514304e7a62b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66000602298490b9e76d8138fdb825b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:31.858235 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-24d08ec5-8b88-4b9e-b892-70415293085d tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] 10.222.0.45 "GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4" status: 200 len: 1315 microversion: 2.1 time: 0.150074 Jun 16 12:27:31.858552 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 66/126] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:31 2022] GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:27:32.615331 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-cc63a45e-aff8-47b3-b81c-c6c0be9b8cda tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:32.616119 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-cc63a45e-aff8-47b3-b81c-c6c0be9b8cda tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: ddba5ba6-d9f4-493c-b15b-9443a5426682] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:32.622252 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cc63a45e-aff8-47b3-b81c-c6c0be9b8cda tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:32.622860 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cc63a45e-aff8-47b3-b81c-c6c0be9b8cda tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:32.623633 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cc63a45e-aff8-47b3-b81c-c6c0be9b8cda tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:32.624066 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cc63a45e-aff8-47b3-b81c-c6c0be9b8cda tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:32.638695 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c4ea6fac-14e4-4828-83d5-dbe2b40bddc7 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:32.639563 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c4ea6fac-14e4-4828-83d5-dbe2b40bddc7 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: 331b2de0-3963-4186-bc19-f2fe2e97d860] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:32.647121 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c4ea6fac-14e4-4828-83d5-dbe2b40bddc7 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:32.647592 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c4ea6fac-14e4-4828-83d5-dbe2b40bddc7 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:32.648331 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c4ea6fac-14e4-4828-83d5-dbe2b40bddc7 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:32.648759 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c4ea6fac-14e4-4828-83d5-dbe2b40bddc7 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:32.825708 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-cc63a45e-aff8-47b3-b81c-c6c0be9b8cda tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:32.830446 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c4ea6fac-14e4-4828-83d5-dbe2b40bddc7 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:32.833752 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-cc63a45e-aff8-47b3-b81c-c6c0be9b8cda tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682" status: 200 len: 1365 microversion: 2.1 time: 0.222172 Jun 16 12:27:32.834366 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 61/127] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:32 2022] GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682 => generated 1365 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:32.840165 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1cfc12fd-68bb-49ff-88d5-0a8253f8bbca tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:32.841897 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c4ea6fac-14e4-4828-83d5-dbe2b40bddc7 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860" status: 200 len: 1521 microversion: 2.1 time: 0.206544 Jun 16 12:27:32.842405 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1cfc12fd-68bb-49ff-88d5-0a8253f8bbca tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:32.846983 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 67/128] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:32 2022] GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860 => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:27:32.848692 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1cfc12fd-68bb-49ff-88d5-0a8253f8bbca tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:32.849132 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1cfc12fd-68bb-49ff-88d5-0a8253f8bbca tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:32.849901 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1cfc12fd-68bb-49ff-88d5-0a8253f8bbca tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:32.850342 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1cfc12fd-68bb-49ff-88d5-0a8253f8bbca tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:32.874733 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f0eff8d2-25e2-405f-8535-61254e15cbf1 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:32.875441 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f0eff8d2-25e2-405f-8535-61254e15cbf1 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] [instance: c72b39de-9695-4833-8a7a-76af4eaa33d4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:32.883247 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f0eff8d2-25e2-405f-8535-61254e15cbf1 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:32.883700 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f0eff8d2-25e2-405f-8535-61254e15cbf1 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:32.884470 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f0eff8d2-25e2-405f-8535-61254e15cbf1 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:32.884906 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f0eff8d2-25e2-405f-8535-61254e15cbf1 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:33.035467 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1cfc12fd-68bb-49ff-88d5-0a8253f8bbca tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:33.043594 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1cfc12fd-68bb-49ff-88d5-0a8253f8bbca tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:33.045287 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1cfc12fd-68bb-49ff-88d5-0a8253f8bbca tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:33.046422 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1cfc12fd-68bb-49ff-88d5-0a8253f8bbca tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1407 microversion: 2.20 time: 0.210189 Jun 16 12:27:33.046997 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 62/129] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:27:32 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1407 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:27:33.061356 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f0eff8d2-25e2-405f-8535-61254e15cbf1 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf22beda54e24b878e514304e7a62b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66000602298490b9e76d8138fdb825b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:33.068899 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f0eff8d2-25e2-405f-8535-61254e15cbf1 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] 10.222.0.45 "GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4" status: 200 len: 1315 microversion: 2.1 time: 0.197956 Jun 16 12:27:33.069467 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 68/130] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:32 2022] GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:27:33.850901 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e9ba83ac-8995-4f6a-969a-47315c7c80eb tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:33.851542 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e9ba83ac-8995-4f6a-969a-47315c7c80eb tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: ddba5ba6-d9f4-493c-b15b-9443a5426682] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:33.857722 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e9ba83ac-8995-4f6a-969a-47315c7c80eb tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:33.858209 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e9ba83ac-8995-4f6a-969a-47315c7c80eb tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:33.858692 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8ef32100-631d-4a86-ba45-08eb98ec3ad1 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:33.859104 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e9ba83ac-8995-4f6a-969a-47315c7c80eb tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:33.859295 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8ef32100-631d-4a86-ba45-08eb98ec3ad1 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: 331b2de0-3963-4186-bc19-f2fe2e97d860] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:33.859416 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e9ba83ac-8995-4f6a-969a-47315c7c80eb tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:33.865283 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8ef32100-631d-4a86-ba45-08eb98ec3ad1 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:33.865673 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8ef32100-631d-4a86-ba45-08eb98ec3ad1 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:33.866463 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8ef32100-631d-4a86-ba45-08eb98ec3ad1 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:33.866901 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8ef32100-631d-4a86-ba45-08eb98ec3ad1 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:34.060507 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8ef32100-631d-4a86-ba45-08eb98ec3ad1 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:34.063875 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e9ba83ac-8995-4f6a-969a-47315c7c80eb tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:34.068801 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8ef32100-631d-4a86-ba45-08eb98ec3ad1 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860" status: 200 len: 1521 microversion: 2.1 time: 0.214287 Jun 16 12:27:34.069374 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 69/131] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:33 2022] GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860 => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:27:34.071327 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e9ba83ac-8995-4f6a-969a-47315c7c80eb tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682" status: 200 len: 1365 microversion: 2.1 time: 0.224214 Jun 16 12:27:34.072055 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 63/132] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:33 2022] GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682 => generated 1365 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:34.073781 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fe903ee6-e776-4373-92b3-4eba5e228a8c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:34.074414 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-fe903ee6-e776-4373-92b3-4eba5e228a8c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:34.081054 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fe903ee6-e776-4373-92b3-4eba5e228a8c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:34.081588 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fe903ee6-e776-4373-92b3-4eba5e228a8c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:34.082393 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fe903ee6-e776-4373-92b3-4eba5e228a8c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:34.082831 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fe903ee6-e776-4373-92b3-4eba5e228a8c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:34.085653 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-225fe455-b973-4245-bfc2-95a93dfe8931 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:34.086637 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-225fe455-b973-4245-bfc2-95a93dfe8931 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] [instance: c72b39de-9695-4833-8a7a-76af4eaa33d4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:34.092405 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-225fe455-b973-4245-bfc2-95a93dfe8931 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:34.092843 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-225fe455-b973-4245-bfc2-95a93dfe8931 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:34.093594 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-225fe455-b973-4245-bfc2-95a93dfe8931 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:34.094050 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-225fe455-b973-4245-bfc2-95a93dfe8931 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:34.281529 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fe903ee6-e776-4373-92b3-4eba5e228a8c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:34.285204 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:34.286700 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-225fe455-b973-4245-bfc2-95a93dfe8931 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf22beda54e24b878e514304e7a62b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66000602298490b9e76d8138fdb825b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:34.291089 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fe903ee6-e776-4373-92b3-4eba5e228a8c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:34.292683 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fe903ee6-e776-4373-92b3-4eba5e228a8c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:34.294059 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-fe903ee6-e776-4373-92b3-4eba5e228a8c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1407 microversion: 2.20 time: 0.223697 Jun 16 12:27:34.298063 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 70/133] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:27:34 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1407 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:27:34.298160 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-225fe455-b973-4245-bfc2-95a93dfe8931 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] 10.222.0.45 "GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4" status: 200 len: 1315 microversion: 2.1 time: 0.213720 Jun 16 12:27:34.298160 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 64/134] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:34 2022] GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:27:35.088642 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-36fc0be7-7efe-4f94-a0a1-936be79d752d tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:35.094246 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f2cc8cf7-3207-4709-b828-dcff6f990c05 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:35.094943 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-36fc0be7-7efe-4f94-a0a1-936be79d752d tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: ddba5ba6-d9f4-493c-b15b-9443a5426682] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:35.097958 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f2cc8cf7-3207-4709-b828-dcff6f990c05 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: 331b2de0-3963-4186-bc19-f2fe2e97d860] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:35.103794 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-36fc0be7-7efe-4f94-a0a1-936be79d752d tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:35.104303 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-36fc0be7-7efe-4f94-a0a1-936be79d752d tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:35.105001 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-36fc0be7-7efe-4f94-a0a1-936be79d752d tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:35.105435 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-36fc0be7-7efe-4f94-a0a1-936be79d752d tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:35.112730 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f2cc8cf7-3207-4709-b828-dcff6f990c05 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:35.113183 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f2cc8cf7-3207-4709-b828-dcff6f990c05 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:35.114049 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f2cc8cf7-3207-4709-b828-dcff6f990c05 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:35.114541 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f2cc8cf7-3207-4709-b828-dcff6f990c05 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:35.334335 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-36fc0be7-7efe-4f94-a0a1-936be79d752d tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:35.336795 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:35.347649 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f2cc8cf7-3207-4709-b828-dcff6f990c05 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:35.348075 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-36fc0be7-7efe-4f94-a0a1-936be79d752d tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682" status: 200 len: 1365 microversion: 2.1 time: 0.262947 Jun 16 12:27:35.348844 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 65/135] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:35 2022] GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682 => generated 1365 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:35.354206 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-485ff378-7012-4380-b75d-22738973fefa tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:35.360594 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-485ff378-7012-4380-b75d-22738973fefa tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:35.360732 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f2cc8cf7-3207-4709-b828-dcff6f990c05 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860" status: 200 len: 1521 microversion: 2.1 time: 0.266279 Jun 16 12:27:35.360979 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-485ff378-7012-4380-b75d-22738973fefa tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:35.361437 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-485ff378-7012-4380-b75d-22738973fefa tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:35.362484 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-485ff378-7012-4380-b75d-22738973fefa tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:35.362708 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-485ff378-7012-4380-b75d-22738973fefa tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:35.365912 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 71/136] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:35 2022] GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860 => generated 1521 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:35.372771 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7c7e0277-e48a-4254-9ba9-7a8f3552f9e3 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:35.373452 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7c7e0277-e48a-4254-9ba9-7a8f3552f9e3 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] [instance: c72b39de-9695-4833-8a7a-76af4eaa33d4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:35.380078 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7c7e0277-e48a-4254-9ba9-7a8f3552f9e3 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:35.380715 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7c7e0277-e48a-4254-9ba9-7a8f3552f9e3 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:35.381472 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7c7e0277-e48a-4254-9ba9-7a8f3552f9e3 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:35.381962 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7c7e0277-e48a-4254-9ba9-7a8f3552f9e3 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:35.575606 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-485ff378-7012-4380-b75d-22738973fefa tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:35.584437 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7c7e0277-e48a-4254-9ba9-7a8f3552f9e3 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf22beda54e24b878e514304e7a62b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66000602298490b9e76d8138fdb825b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:35.585169 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-485ff378-7012-4380-b75d-22738973fefa tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:35.586805 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-485ff378-7012-4380-b75d-22738973fefa tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:35.588008 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-485ff378-7012-4380-b75d-22738973fefa tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1407 microversion: 2.20 time: 0.238227 Jun 16 12:27:35.588832 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 66/137] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:27:35 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1407 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:27:35.593725 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7c7e0277-e48a-4254-9ba9-7a8f3552f9e3 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] 10.222.0.45 "GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4" status: 200 len: 1315 microversion: 2.1 time: 0.225688 Jun 16 12:27:35.594473 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 72/138] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:35 2022] GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4 => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:36.368941 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-16a9db61-2b74-493c-ae3e-8ecc36ed1509 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:36.369537 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-16a9db61-2b74-493c-ae3e-8ecc36ed1509 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: ddba5ba6-d9f4-493c-b15b-9443a5426682] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:36.372370 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c89024e6-7498-4e3c-b1b8-74566a9eb9d9 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:36.373057 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c89024e6-7498-4e3c-b1b8-74566a9eb9d9 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: 331b2de0-3963-4186-bc19-f2fe2e97d860] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:36.376754 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-16a9db61-2b74-493c-ae3e-8ecc36ed1509 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:36.377381 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-16a9db61-2b74-493c-ae3e-8ecc36ed1509 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:36.378181 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-16a9db61-2b74-493c-ae3e-8ecc36ed1509 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:36.378610 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-16a9db61-2b74-493c-ae3e-8ecc36ed1509 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:36.379532 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c89024e6-7498-4e3c-b1b8-74566a9eb9d9 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:36.380064 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c89024e6-7498-4e3c-b1b8-74566a9eb9d9 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:36.381037 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c89024e6-7498-4e3c-b1b8-74566a9eb9d9 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:36.381666 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c89024e6-7498-4e3c-b1b8-74566a9eb9d9 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:36.607073 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c89024e6-7498-4e3c-b1b8-74566a9eb9d9 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:36.610410 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-16a9db61-2b74-493c-ae3e-8ecc36ed1509 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:36.614948 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c89024e6-7498-4e3c-b1b8-74566a9eb9d9 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860" status: 200 len: 1521 microversion: 2.1 time: 0.246497 Jun 16 12:27:36.615791 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 73/139] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:36 2022] GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860 => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:27:36.620647 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-89589852-1788-4912-9f4c-c96661744f59 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:36.620794 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-16a9db61-2b74-493c-ae3e-8ecc36ed1509 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682" status: 200 len: 1365 microversion: 2.1 time: 0.255879 Jun 16 12:27:36.621390 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 67/140] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:36 2022] GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682 => generated 1365 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:36.621495 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-89589852-1788-4912-9f4c-c96661744f59 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:36.627264 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-89589852-1788-4912-9f4c-c96661744f59 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:36.627893 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-89589852-1788-4912-9f4c-c96661744f59 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:36.628672 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-89589852-1788-4912-9f4c-c96661744f59 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:36.629111 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-89589852-1788-4912-9f4c-c96661744f59 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:36.630518 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b1574d99-03b4-4f52-8725-c1db87526a24 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:36.631118 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b1574d99-03b4-4f52-8725-c1db87526a24 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] [instance: c72b39de-9695-4833-8a7a-76af4eaa33d4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:36.636961 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b1574d99-03b4-4f52-8725-c1db87526a24 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:36.637399 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b1574d99-03b4-4f52-8725-c1db87526a24 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:36.638400 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b1574d99-03b4-4f52-8725-c1db87526a24 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:36.639712 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b1574d99-03b4-4f52-8725-c1db87526a24 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:36.844142 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-89589852-1788-4912-9f4c-c96661744f59 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:36.853204 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-89589852-1788-4912-9f4c-c96661744f59 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:36.853391 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b1574d99-03b4-4f52-8725-c1db87526a24 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf22beda54e24b878e514304e7a62b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66000602298490b9e76d8138fdb825b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:36.855124 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-89589852-1788-4912-9f4c-c96661744f59 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:36.856403 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-89589852-1788-4912-9f4c-c96661744f59 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1407 microversion: 2.20 time: 0.239495 Jun 16 12:27:36.857481 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 74/141] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:27:36 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1407 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:27:36.861778 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b1574d99-03b4-4f52-8725-c1db87526a24 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] 10.222.0.45 "GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4" status: 200 len: 1315 microversion: 2.1 time: 0.234738 Jun 16 12:27:36.862686 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 68/142] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:36 2022] GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4 => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:37.632232 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c6bec399-9774-486c-a891-7f535f54003f tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:37.632848 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c6bec399-9774-486c-a891-7f535f54003f tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: 331b2de0-3963-4186-bc19-f2fe2e97d860] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:37.636847 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a1ee00d1-daef-4b2e-9b42-859f8e77f7ad tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:37.637461 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a1ee00d1-daef-4b2e-9b42-859f8e77f7ad tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: ddba5ba6-d9f4-493c-b15b-9443a5426682] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:37.639952 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c6bec399-9774-486c-a891-7f535f54003f tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:37.640319 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c6bec399-9774-486c-a891-7f535f54003f tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:37.641270 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c6bec399-9774-486c-a891-7f535f54003f tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:37.641709 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c6bec399-9774-486c-a891-7f535f54003f tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:37.642909 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=92 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:37.644783 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a1ee00d1-daef-4b2e-9b42-859f8e77f7ad tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:37.645226 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a1ee00d1-daef-4b2e-9b42-859f8e77f7ad tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:37.646140 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a1ee00d1-daef-4b2e-9b42-859f8e77f7ad tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:37.646577 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a1ee00d1-daef-4b2e-9b42-859f8e77f7ad tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:38.051700 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c6bec399-9774-486c-a891-7f535f54003f tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:38.058982 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a1ee00d1-daef-4b2e-9b42-859f8e77f7ad tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:38.059773 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c6bec399-9774-486c-a891-7f535f54003f tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860" status: 200 len: 1521 microversion: 2.1 time: 0.431284 Jun 16 12:27:38.060342 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 75/143] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:37 2022] GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860 => generated 1521 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:38.065759 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a227c673-ee14-4394-9e31-c15b69c820ed tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:38.066619 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a227c673-ee14-4394-9e31-c15b69c820ed tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:38.067716 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a1ee00d1-daef-4b2e-9b42-859f8e77f7ad tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682" status: 200 len: 1365 microversion: 2.1 time: 0.435186 Jun 16 12:27:38.068624 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 69/144] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:37 2022] GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682 => generated 1365 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:38.073264 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d8ee6ad2-bc43-4405-84aa-50e36ddee251 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:38.073898 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d8ee6ad2-bc43-4405-84aa-50e36ddee251 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] [instance: c72b39de-9695-4833-8a7a-76af4eaa33d4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:38.074187 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a227c673-ee14-4394-9e31-c15b69c820ed tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:38.074820 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a227c673-ee14-4394-9e31-c15b69c820ed tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:38.075645 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a227c673-ee14-4394-9e31-c15b69c820ed tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:38.076143 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a227c673-ee14-4394-9e31-c15b69c820ed tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:38.080301 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d8ee6ad2-bc43-4405-84aa-50e36ddee251 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:38.080751 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d8ee6ad2-bc43-4405-84aa-50e36ddee251 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:38.081547 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d8ee6ad2-bc43-4405-84aa-50e36ddee251 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:38.083890 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d8ee6ad2-bc43-4405-84aa-50e36ddee251 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:38.290303 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a227c673-ee14-4394-9e31-c15b69c820ed tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:38.293398 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d8ee6ad2-bc43-4405-84aa-50e36ddee251 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf22beda54e24b878e514304e7a62b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66000602298490b9e76d8138fdb825b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:38.302125 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a227c673-ee14-4394-9e31-c15b69c820ed tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:38.302337 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d8ee6ad2-bc43-4405-84aa-50e36ddee251 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] 10.222.0.45 "GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4" status: 200 len: 1315 microversion: 2.1 time: 0.232606 Jun 16 12:27:38.303439 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 70/145] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:38 2022] GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4 => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:38.304343 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a227c673-ee14-4394-9e31-c15b69c820ed tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:38.305532 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a227c673-ee14-4394-9e31-c15b69c820ed tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1407 microversion: 2.20 time: 0.243301 Jun 16 12:27:38.306267 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 76/146] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:27:38 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1407 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:27:39.077738 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c0d05a9c-1fb4-4cdc-aa4a-0a53ec579b3a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:39.079034 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c0d05a9c-1fb4-4cdc-aa4a-0a53ec579b3a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: 331b2de0-3963-4186-bc19-f2fe2e97d860] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:39.085991 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-35935f6d-731a-4b57-930a-4a3b99c593b8 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:39.087358 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-35935f6d-731a-4b57-930a-4a3b99c593b8 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: ddba5ba6-d9f4-493c-b15b-9443a5426682] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:39.098739 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-35935f6d-731a-4b57-930a-4a3b99c593b8 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:39.101322 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-35935f6d-731a-4b57-930a-4a3b99c593b8 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:39.102688 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-35935f6d-731a-4b57-930a-4a3b99c593b8 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:39.103947 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c0d05a9c-1fb4-4cdc-aa4a-0a53ec579b3a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:39.104601 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-35935f6d-731a-4b57-930a-4a3b99c593b8 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:39.105187 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c0d05a9c-1fb4-4cdc-aa4a-0a53ec579b3a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:39.107719 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c0d05a9c-1fb4-4cdc-aa4a-0a53ec579b3a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:39.108264 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c0d05a9c-1fb4-4cdc-aa4a-0a53ec579b3a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:39.325839 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-35935f6d-731a-4b57-930a-4a3b99c593b8 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:39.336872 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-35935f6d-731a-4b57-930a-4a3b99c593b8 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682" status: 200 len: 1365 microversion: 2.1 time: 0.254995 Jun 16 12:27:39.337740 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 77/147] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:39 2022] GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682 => generated 1365 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:39.340450 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c0d05a9c-1fb4-4cdc-aa4a-0a53ec579b3a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:39.344248 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-88f31571-5521-4513-a19e-9440fedad62e tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:39.344853 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-88f31571-5521-4513-a19e-9440fedad62e tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] [instance: c72b39de-9695-4833-8a7a-76af4eaa33d4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:39.349626 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c0d05a9c-1fb4-4cdc-aa4a-0a53ec579b3a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860" status: 200 len: 1521 microversion: 2.1 time: 0.276812 Jun 16 12:27:39.351589 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-88f31571-5521-4513-a19e-9440fedad62e tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:39.352037 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-88f31571-5521-4513-a19e-9440fedad62e tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:39.352805 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-88f31571-5521-4513-a19e-9440fedad62e tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:39.353373 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-88f31571-5521-4513-a19e-9440fedad62e tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:39.362153 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 71/148] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:39 2022] GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860 => generated 1521 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:27:39.368175 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-272cbd71-5884-446e-a7d3-fae1d1708fcf tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:39.368782 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-272cbd71-5884-446e-a7d3-fae1d1708fcf tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:39.375597 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-272cbd71-5884-446e-a7d3-fae1d1708fcf tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:39.376291 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-272cbd71-5884-446e-a7d3-fae1d1708fcf tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:39.377050 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-272cbd71-5884-446e-a7d3-fae1d1708fcf tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:39.377481 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-272cbd71-5884-446e-a7d3-fae1d1708fcf tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:39.561902 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-88f31571-5521-4513-a19e-9440fedad62e tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf22beda54e24b878e514304e7a62b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66000602298490b9e76d8138fdb825b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:39.572920 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-88f31571-5521-4513-a19e-9440fedad62e tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] 10.222.0.45 "GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4" status: 200 len: 1315 microversion: 2.1 time: 0.230414 Jun 16 12:27:39.572920 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 78/149] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:39 2022] GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4 => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:39.573332 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-272cbd71-5884-446e-a7d3-fae1d1708fcf tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:39.581326 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-272cbd71-5884-446e-a7d3-fae1d1708fcf tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:39.583085 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-272cbd71-5884-446e-a7d3-fae1d1708fcf tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:39.584369 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-272cbd71-5884-446e-a7d3-fae1d1708fcf tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1407 microversion: 2.20 time: 0.221131 Jun 16 12:27:39.584921 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 72/150] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:27:39 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1407 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:27:40.354327 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-959e3608-214e-4856-9f65-03d3fd3cd7ec tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:40.355684 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-959e3608-214e-4856-9f65-03d3fd3cd7ec tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: ddba5ba6-d9f4-493c-b15b-9443a5426682] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:40.363611 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-959e3608-214e-4856-9f65-03d3fd3cd7ec tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:40.364059 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-959e3608-214e-4856-9f65-03d3fd3cd7ec tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:40.364911 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-959e3608-214e-4856-9f65-03d3fd3cd7ec tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:40.365411 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-959e3608-214e-4856-9f65-03d3fd3cd7ec tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:40.370491 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c600b53f-bbf9-4e39-a644-5d2ae1adad55 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:40.371109 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c600b53f-bbf9-4e39-a644-5d2ae1adad55 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: 331b2de0-3963-4186-bc19-f2fe2e97d860] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:40.378231 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c600b53f-bbf9-4e39-a644-5d2ae1adad55 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:40.378990 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c600b53f-bbf9-4e39-a644-5d2ae1adad55 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:40.380008 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c600b53f-bbf9-4e39-a644-5d2ae1adad55 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:40.380890 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c600b53f-bbf9-4e39-a644-5d2ae1adad55 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:40.581722 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-959e3608-214e-4856-9f65-03d3fd3cd7ec tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:40.585217 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c600b53f-bbf9-4e39-a644-5d2ae1adad55 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:40.589383 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-959e3608-214e-4856-9f65-03d3fd3cd7ec tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682" status: 200 len: 1365 microversion: 2.1 time: 0.239988 Jun 16 12:27:40.590072 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 79/151] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:40 2022] GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682 => generated 1365 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:40.593039 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c600b53f-bbf9-4e39-a644-5d2ae1adad55 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860" status: 200 len: 1521 microversion: 2.1 time: 0.226773 Jun 16 12:27:40.593815 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 73/152] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:40 2022] GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860 => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:40.594802 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2aaadc67-8cf8-424e-914f-bac0baf06bfe tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:40.595414 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2aaadc67-8cf8-424e-914f-bac0baf06bfe tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] [instance: c72b39de-9695-4833-8a7a-76af4eaa33d4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:40.601291 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2aaadc67-8cf8-424e-914f-bac0baf06bfe tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:40.601741 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2aaadc67-8cf8-424e-914f-bac0baf06bfe tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:40.602542 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2aaadc67-8cf8-424e-914f-bac0baf06bfe tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:40.602979 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2aaadc67-8cf8-424e-914f-bac0baf06bfe tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:40.603394 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-07d9b35b-e031-41a9-9291-2e271d1236c5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:40.604225 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-07d9b35b-e031-41a9-9291-2e271d1236c5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:40.610966 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-07d9b35b-e031-41a9-9291-2e271d1236c5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:40.611459 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-07d9b35b-e031-41a9-9291-2e271d1236c5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:40.612223 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-07d9b35b-e031-41a9-9291-2e271d1236c5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:40.612657 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-07d9b35b-e031-41a9-9291-2e271d1236c5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:40.816081 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2aaadc67-8cf8-424e-914f-bac0baf06bfe tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf22beda54e24b878e514304e7a62b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66000602298490b9e76d8138fdb825b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:40.820486 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-07d9b35b-e031-41a9-9291-2e271d1236c5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:40.824691 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2aaadc67-8cf8-424e-914f-bac0baf06bfe tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] 10.222.0.45 "GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4" status: 200 len: 1315 microversion: 2.1 time: 0.233217 Jun 16 12:27:40.835968 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 80/153] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:40 2022] GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4 => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:40.839788 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-07d9b35b-e031-41a9-9291-2e271d1236c5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:40.841589 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-07d9b35b-e031-41a9-9291-2e271d1236c5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:40.843112 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-07d9b35b-e031-41a9-9291-2e271d1236c5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1407 microversion: 2.20 time: 0.244399 Jun 16 12:27:40.844069 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 74/154] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:27:40 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1407 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:27:41.612521 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e68ce010-7445-4e88-8c49-87d55683e011 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:41.613943 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e68ce010-7445-4e88-8c49-87d55683e011 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: ddba5ba6-d9f4-493c-b15b-9443a5426682] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:41.614634 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-9d7fb02f-db1d-404b-b574-b255905604a1 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:41.615253 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-9d7fb02f-db1d-404b-b574-b255905604a1 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: 331b2de0-3963-4186-bc19-f2fe2e97d860] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:41.622304 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9d7fb02f-db1d-404b-b574-b255905604a1 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:41.622973 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9d7fb02f-db1d-404b-b574-b255905604a1 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:41.624149 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9d7fb02f-db1d-404b-b574-b255905604a1 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:41.624777 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9d7fb02f-db1d-404b-b574-b255905604a1 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:41.631487 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e68ce010-7445-4e88-8c49-87d55683e011 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:41.632255 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e68ce010-7445-4e88-8c49-87d55683e011 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:41.634093 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e68ce010-7445-4e88-8c49-87d55683e011 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:41.635163 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e68ce010-7445-4e88-8c49-87d55683e011 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:41.860301 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e68ce010-7445-4e88-8c49-87d55683e011 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:41.872219 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-9d7fb02f-db1d-404b-b574-b255905604a1 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:41.874184 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e68ce010-7445-4e88-8c49-87d55683e011 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682" status: 200 len: 1365 microversion: 2.1 time: 0.264588 Jun 16 12:27:41.874896 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 81/155] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:41 2022] GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682 => generated 1365 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:41.881183 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0cd45776-a464-493c-a705-f092c20da03c tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:41.881709 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-9d7fb02f-db1d-404b-b574-b255905604a1 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860" status: 200 len: 1521 microversion: 2.1 time: 0.270916 Jun 16 12:27:41.882811 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0cd45776-a464-493c-a705-f092c20da03c tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] [instance: c72b39de-9695-4833-8a7a-76af4eaa33d4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:41.889911 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=91 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:41.891956 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 75/156] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:41 2022] GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860 => generated 1521 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:27:41.893118 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0cd45776-a464-493c-a705-f092c20da03c tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:41.894335 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0cd45776-a464-493c-a705-f092c20da03c tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:41.895586 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0cd45776-a464-493c-a705-f092c20da03c tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:41.896301 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0cd45776-a464-493c-a705-f092c20da03c tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:41.898206 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-768ceaaf-7351-4b8d-8831-1e3806396353 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:41.899335 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-768ceaaf-7351-4b8d-8831-1e3806396353 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:41.907226 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-768ceaaf-7351-4b8d-8831-1e3806396353 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:41.908243 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-768ceaaf-7351-4b8d-8831-1e3806396353 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:41.909356 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-768ceaaf-7351-4b8d-8831-1e3806396353 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:41.911002 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-768ceaaf-7351-4b8d-8831-1e3806396353 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:42.146836 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-768ceaaf-7351-4b8d-8831-1e3806396353 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:42.149629 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0cd45776-a464-493c-a705-f092c20da03c tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf22beda54e24b878e514304e7a62b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66000602298490b9e76d8138fdb825b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:42.155205 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-768ceaaf-7351-4b8d-8831-1e3806396353 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:42.156755 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-768ceaaf-7351-4b8d-8831-1e3806396353 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:42.157166 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0cd45776-a464-493c-a705-f092c20da03c tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] 10.222.0.45 "GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4" status: 200 len: 1315 microversion: 2.1 time: 0.280979 Jun 16 12:27:42.157832 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 82/157] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:41 2022] GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4 => generated 1315 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:42.158077 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-768ceaaf-7351-4b8d-8831-1e3806396353 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1407 microversion: 2.20 time: 0.264803 Jun 16 12:27:42.158548 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 76/158] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:27:41 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1407 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:27:42.891810 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-84500d05-3e81-407c-8565-10bedbb376f8 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:42.892455 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-84500d05-3e81-407c-8565-10bedbb376f8 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: ddba5ba6-d9f4-493c-b15b-9443a5426682] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:42.899101 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-84500d05-3e81-407c-8565-10bedbb376f8 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:42.899556 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-84500d05-3e81-407c-8565-10bedbb376f8 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:42.900324 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-84500d05-3e81-407c-8565-10bedbb376f8 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:42.900431 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7da42d2d-a66c-4d3d-99c0-bec53654af47 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:42.900828 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-84500d05-3e81-407c-8565-10bedbb376f8 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:42.900981 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7da42d2d-a66c-4d3d-99c0-bec53654af47 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: 331b2de0-3963-4186-bc19-f2fe2e97d860] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:42.908180 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7da42d2d-a66c-4d3d-99c0-bec53654af47 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:42.908618 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7da42d2d-a66c-4d3d-99c0-bec53654af47 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:42.909365 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7da42d2d-a66c-4d3d-99c0-bec53654af47 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:42.909791 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7da42d2d-a66c-4d3d-99c0-bec53654af47 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:43.094743 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-84500d05-3e81-407c-8565-10bedbb376f8 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:43.099977 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7da42d2d-a66c-4d3d-99c0-bec53654af47 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:43.102635 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-84500d05-3e81-407c-8565-10bedbb376f8 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682" status: 200 len: 1365 microversion: 2.1 time: 0.215526 Jun 16 12:27:43.103537 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 83/159] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:42 2022] GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682 => generated 1365 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:43.115861 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7da42d2d-a66c-4d3d-99c0-bec53654af47 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860" status: 200 len: 1521 microversion: 2.1 time: 0.219157 Jun 16 12:27:43.116427 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 77/160] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:42 2022] GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860 => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:27:43.173163 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9273fb87-3911-4151-ab46-45e04656499a tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:43.173774 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9273fb87-3911-4151-ab46-45e04656499a tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] [instance: c72b39de-9695-4833-8a7a-76af4eaa33d4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:43.175764 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d147e086-5a94-474c-8026-ed07bc1c94e6 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:43.176774 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d147e086-5a94-474c-8026-ed07bc1c94e6 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:43.179834 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9273fb87-3911-4151-ab46-45e04656499a tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:43.180325 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9273fb87-3911-4151-ab46-45e04656499a tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:43.181298 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9273fb87-3911-4151-ab46-45e04656499a tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:43.181773 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9273fb87-3911-4151-ab46-45e04656499a tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:43.182764 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d147e086-5a94-474c-8026-ed07bc1c94e6 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:43.183323 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d147e086-5a94-474c-8026-ed07bc1c94e6 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:43.184387 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d147e086-5a94-474c-8026-ed07bc1c94e6 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:43.184930 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d147e086-5a94-474c-8026-ed07bc1c94e6 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:43.374599 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d147e086-5a94-474c-8026-ed07bc1c94e6 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:43.378587 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9273fb87-3911-4151-ab46-45e04656499a tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf22beda54e24b878e514304e7a62b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66000602298490b9e76d8138fdb825b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:43.382493 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d147e086-5a94-474c-8026-ed07bc1c94e6 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:43.383989 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d147e086-5a94-474c-8026-ed07bc1c94e6 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:43.385122 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d147e086-5a94-474c-8026-ed07bc1c94e6 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1407 microversion: 2.20 time: 0.212989 Jun 16 12:27:43.385681 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 78/161] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:27:43 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1407 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 12:27:43.385902 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9273fb87-3911-4151-ab46-45e04656499a tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] 10.222.0.45 "GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4" status: 200 len: 1315 microversion: 2.1 time: 0.216505 Jun 16 12:27:43.386617 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 84/162] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:43 2022] GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4 => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:44.119746 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3a479147-480b-44ec-95fd-82a5d9c79d37 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:44.120461 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3a479147-480b-44ec-95fd-82a5d9c79d37 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: ddba5ba6-d9f4-493c-b15b-9443a5426682] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:44.127723 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3a479147-480b-44ec-95fd-82a5d9c79d37 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:44.128169 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3a479147-480b-44ec-95fd-82a5d9c79d37 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:44.129099 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3a479147-480b-44ec-95fd-82a5d9c79d37 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:44.129682 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3a479147-480b-44ec-95fd-82a5d9c79d37 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:44.133293 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c4162147-b60b-408b-93e3-4bd21ee550b6 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:44.133293 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c4162147-b60b-408b-93e3-4bd21ee550b6 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: 331b2de0-3963-4186-bc19-f2fe2e97d860] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:44.139231 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c4162147-b60b-408b-93e3-4bd21ee550b6 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:44.139885 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c4162147-b60b-408b-93e3-4bd21ee550b6 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:44.140655 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c4162147-b60b-408b-93e3-4bd21ee550b6 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:44.141150 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c4162147-b60b-408b-93e3-4bd21ee550b6 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:44.341432 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-3a479147-480b-44ec-95fd-82a5d9c79d37 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:44.346185 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c4162147-b60b-408b-93e3-4bd21ee550b6 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:44.349834 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3a479147-480b-44ec-95fd-82a5d9c79d37 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682" status: 200 len: 1365 microversion: 2.1 time: 0.233855 Jun 16 12:27:44.350431 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 79/163] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:44 2022] GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682 => generated 1365 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:44.353641 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c4162147-b60b-408b-93e3-4bd21ee550b6 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860" status: 200 len: 1521 microversion: 2.1 time: 0.225085 Jun 16 12:27:44.354379 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 85/164] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:44 2022] GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860 => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:44.402094 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a8398821-017f-4adc-9208-09a4fc08565d tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:44.402313 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-afd3c0ba-83a0-4f5b-b71f-51761c124a97 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:44.402801 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-afd3c0ba-83a0-4f5b-b71f-51761c124a97 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:44.402901 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a8398821-017f-4adc-9208-09a4fc08565d tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] [instance: c72b39de-9695-4833-8a7a-76af4eaa33d4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:44.409332 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-afd3c0ba-83a0-4f5b-b71f-51761c124a97 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:44.409504 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a8398821-017f-4adc-9208-09a4fc08565d tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:44.409784 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-afd3c0ba-83a0-4f5b-b71f-51761c124a97 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:44.409913 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a8398821-017f-4adc-9208-09a4fc08565d tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:44.410584 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a8398821-017f-4adc-9208-09a4fc08565d tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:44.410943 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-afd3c0ba-83a0-4f5b-b71f-51761c124a97 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:44.411283 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a8398821-017f-4adc-9208-09a4fc08565d tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:44.411375 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-afd3c0ba-83a0-4f5b-b71f-51761c124a97 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:44.607064 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a8398821-017f-4adc-9208-09a4fc08565d tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf22beda54e24b878e514304e7a62b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66000602298490b9e76d8138fdb825b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:44.607587 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-afd3c0ba-83a0-4f5b-b71f-51761c124a97 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:44.614805 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a8398821-017f-4adc-9208-09a4fc08565d tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] 10.222.0.45 "GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4" status: 200 len: 1315 microversion: 2.1 time: 0.216517 Jun 16 12:27:44.615375 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 80/165] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:44 2022] GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4 => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:44.615498 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-afd3c0ba-83a0-4f5b-b71f-51761c124a97 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:44.617212 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-afd3c0ba-83a0-4f5b-b71f-51761c124a97 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:44.618326 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-afd3c0ba-83a0-4f5b-b71f-51761c124a97 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1407 microversion: 2.20 time: 0.219868 Jun 16 12:27:44.618866 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 86/166] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:27:44 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1407 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 12:27:45.366894 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-988af61d-9a2d-482f-ba72-a8ab77adf32b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:45.367528 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-988af61d-9a2d-482f-ba72-a8ab77adf32b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: ddba5ba6-d9f4-493c-b15b-9443a5426682] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:45.370097 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5d7a63e0-f742-4d8f-a37e-667e74c29eb5 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:45.370701 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5d7a63e0-f742-4d8f-a37e-667e74c29eb5 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: 331b2de0-3963-4186-bc19-f2fe2e97d860] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:45.375230 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-988af61d-9a2d-482f-ba72-a8ab77adf32b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:45.375990 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-988af61d-9a2d-482f-ba72-a8ab77adf32b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:45.377069 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-988af61d-9a2d-482f-ba72-a8ab77adf32b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:45.377180 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5d7a63e0-f742-4d8f-a37e-667e74c29eb5 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:45.377561 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5d7a63e0-f742-4d8f-a37e-667e74c29eb5 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:45.377970 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-988af61d-9a2d-482f-ba72-a8ab77adf32b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:45.378353 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5d7a63e0-f742-4d8f-a37e-667e74c29eb5 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:45.378777 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5d7a63e0-f742-4d8f-a37e-667e74c29eb5 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:45.397589 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:45.573714 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-988af61d-9a2d-482f-ba72-a8ab77adf32b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:45.580639 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5d7a63e0-f742-4d8f-a37e-667e74c29eb5 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:45.584618 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-988af61d-9a2d-482f-ba72-a8ab77adf32b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682" status: 200 len: 1365 microversion: 2.1 time: 0.221514 Jun 16 12:27:45.585337 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 81/167] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:45 2022] GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682 => generated 1365 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:45.588128 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5d7a63e0-f742-4d8f-a37e-667e74c29eb5 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860" status: 200 len: 1521 microversion: 2.1 time: 0.221608 Jun 16 12:27:45.588678 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 87/168] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:45 2022] GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860 => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:27:45.631779 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b6012efe-08cd-4956-a6f0-39e1abe53b9e tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:45.632413 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b6012efe-08cd-4956-a6f0-39e1abe53b9e tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] [instance: c72b39de-9695-4833-8a7a-76af4eaa33d4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:45.636134 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a99e2110-90e9-4145-9cbc-98e27bb765fe tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:45.636741 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a99e2110-90e9-4145-9cbc-98e27bb765fe tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:45.638443 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b6012efe-08cd-4956-a6f0-39e1abe53b9e tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:45.640009 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b6012efe-08cd-4956-a6f0-39e1abe53b9e tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:45.640782 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b6012efe-08cd-4956-a6f0-39e1abe53b9e tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:45.641212 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b6012efe-08cd-4956-a6f0-39e1abe53b9e tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:45.643480 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a99e2110-90e9-4145-9cbc-98e27bb765fe tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:45.643955 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a99e2110-90e9-4145-9cbc-98e27bb765fe tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:45.644715 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a99e2110-90e9-4145-9cbc-98e27bb765fe tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:45.645148 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a99e2110-90e9-4145-9cbc-98e27bb765fe tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:45.656775 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:45.834162 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b6012efe-08cd-4956-a6f0-39e1abe53b9e tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf22beda54e24b878e514304e7a62b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66000602298490b9e76d8138fdb825b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:45.838289 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a99e2110-90e9-4145-9cbc-98e27bb765fe tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:45.841450 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b6012efe-08cd-4956-a6f0-39e1abe53b9e tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] 10.222.0.45 "GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4" status: 200 len: 1315 microversion: 2.1 time: 0.213404 Jun 16 12:27:45.843234 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 82/169] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:45 2022] GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:45.846881 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a99e2110-90e9-4145-9cbc-98e27bb765fe tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:45.848390 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a99e2110-90e9-4145-9cbc-98e27bb765fe tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:45.849549 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a99e2110-90e9-4145-9cbc-98e27bb765fe tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1407 microversion: 2.20 time: 0.217126 Jun 16 12:27:45.850140 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 88/170] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:27:45 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1407 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 12:27:46.602592 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c8823bde-3af4-4cdc-b861-b2cbcc10ed1f tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:46.603201 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c8823bde-3af4-4cdc-b861-b2cbcc10ed1f tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: ddba5ba6-d9f4-493c-b15b-9443a5426682] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:46.605761 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-eee3191a-4fd0-4842-89a6-6088e0655407 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:46.608053 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-eee3191a-4fd0-4842-89a6-6088e0655407 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: 331b2de0-3963-4186-bc19-f2fe2e97d860] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:46.610958 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c8823bde-3af4-4cdc-b861-b2cbcc10ed1f tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:46.611484 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c8823bde-3af4-4cdc-b861-b2cbcc10ed1f tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:46.612157 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c8823bde-3af4-4cdc-b861-b2cbcc10ed1f tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:46.612759 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c8823bde-3af4-4cdc-b861-b2cbcc10ed1f tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:46.615609 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eee3191a-4fd0-4842-89a6-6088e0655407 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:46.616258 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eee3191a-4fd0-4842-89a6-6088e0655407 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:46.617338 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eee3191a-4fd0-4842-89a6-6088e0655407 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:46.617986 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eee3191a-4fd0-4842-89a6-6088e0655407 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:46.829317 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-eee3191a-4fd0-4842-89a6-6088e0655407 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:46.833151 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c8823bde-3af4-4cdc-b861-b2cbcc10ed1f tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:46.836959 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-eee3191a-4fd0-4842-89a6-6088e0655407 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860" status: 200 len: 1521 microversion: 2.1 time: 0.235786 Jun 16 12:27:46.837533 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 89/171] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:46 2022] GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860 => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:27:46.840680 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c8823bde-3af4-4cdc-b861-b2cbcc10ed1f tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682" status: 200 len: 1365 microversion: 2.1 time: 0.242269 Jun 16 12:27:46.841227 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 83/172] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:46 2022] GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682 => generated 1365 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:46.860394 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d126c28b-3f7a-425b-9786-ace883a47b9d tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:46.860919 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d126c28b-3f7a-425b-9786-ace883a47b9d tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] [instance: c72b39de-9695-4833-8a7a-76af4eaa33d4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:46.869811 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d126c28b-3f7a-425b-9786-ace883a47b9d tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:46.870513 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d126c28b-3f7a-425b-9786-ace883a47b9d tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:46.871612 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d126c28b-3f7a-425b-9786-ace883a47b9d tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:46.871765 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-268392d4-119d-4b1a-8426-bdcc332255df tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:46.872048 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d126c28b-3f7a-425b-9786-ace883a47b9d tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:46.872375 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-268392d4-119d-4b1a-8426-bdcc332255df tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:46.878767 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-268392d4-119d-4b1a-8426-bdcc332255df tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:46.879216 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-268392d4-119d-4b1a-8426-bdcc332255df tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:46.879975 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-268392d4-119d-4b1a-8426-bdcc332255df tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:46.880529 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-268392d4-119d-4b1a-8426-bdcc332255df tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:47.077294 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-268392d4-119d-4b1a-8426-bdcc332255df tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:47.087706 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d126c28b-3f7a-425b-9786-ace883a47b9d tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf22beda54e24b878e514304e7a62b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66000602298490b9e76d8138fdb825b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:47.090289 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-268392d4-119d-4b1a-8426-bdcc332255df tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:47.092514 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-268392d4-119d-4b1a-8426-bdcc332255df tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:47.093680 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-268392d4-119d-4b1a-8426-bdcc332255df tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1407 microversion: 2.20 time: 0.230211 Jun 16 12:27:47.096947 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d126c28b-3f7a-425b-9786-ace883a47b9d tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] 10.222.0.45 "GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4" status: 200 len: 1315 microversion: 2.1 time: 0.241709 Jun 16 12:27:47.107175 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 90/173] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:46 2022] GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4 => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:27:47.110059 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 84/174] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:27:46 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1407 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:27:47.267334 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-241b6a2a-fa0b-4d5f-8ba1-d3948cd51d01 req-acddae03-5748-4453-bd17-f5d7f8758225 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c72b39de-9695-4833-8a7a-76af4eaa33d4", "name": "network-vif-plugged", "status": "completed", "tag": "c043bee4-c23f-4c99-b00d-fb8989bd7376"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:27:47.276046 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-241b6a2a-fa0b-4d5f-8ba1-d3948cd51d01 req-acddae03-5748-4453-bd17-f5d7f8758225 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:47.277013 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-241b6a2a-fa0b-4d5f-8ba1-d3948cd51d01 req-acddae03-5748-4453-bd17-f5d7f8758225 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:47.298755 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-241b6a2a-fa0b-4d5f-8ba1-d3948cd51d01 req-acddae03-5748-4453-bd17-f5d7f8758225 service nova] Creating event network-vif-plugged:c043bee4-c23f-4c99-b00d-fb8989bd7376 for instance c72b39de-9695-4833-8a7a-76af4eaa33d4 on hv-cinder-84614 Jun 16 12:27:47.304485 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-241b6a2a-fa0b-4d5f-8ba1-d3948cd51d01 req-acddae03-5748-4453-bd17-f5d7f8758225 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041916 Jun 16 12:27:47.306233 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 91/175] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:27:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:27:47.854647 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-37c1bcb0-fb80-4e6a-a567-d61f20f69d47 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:47.855192 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-37c1bcb0-fb80-4e6a-a567-d61f20f69d47 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: 331b2de0-3963-4186-bc19-f2fe2e97d860] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:47.860408 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6f89ed9e-16f6-4ca0-9ddb-7a8f6eaa3efd tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:47.861102 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6f89ed9e-16f6-4ca0-9ddb-7a8f6eaa3efd tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: ddba5ba6-d9f4-493c-b15b-9443a5426682] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:47.861228 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-37c1bcb0-fb80-4e6a-a567-d61f20f69d47 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:47.861597 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-37c1bcb0-fb80-4e6a-a567-d61f20f69d47 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:47.862385 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-37c1bcb0-fb80-4e6a-a567-d61f20f69d47 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:47.862854 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-37c1bcb0-fb80-4e6a-a567-d61f20f69d47 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:47.867997 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6f89ed9e-16f6-4ca0-9ddb-7a8f6eaa3efd tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:47.868449 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6f89ed9e-16f6-4ca0-9ddb-7a8f6eaa3efd tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:47.869217 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6f89ed9e-16f6-4ca0-9ddb-7a8f6eaa3efd tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:47.869654 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6f89ed9e-16f6-4ca0-9ddb-7a8f6eaa3efd tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:48.057244 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-37c1bcb0-fb80-4e6a-a567-d61f20f69d47 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:48.060224 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6f89ed9e-16f6-4ca0-9ddb-7a8f6eaa3efd tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:48.065139 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-37c1bcb0-fb80-4e6a-a567-d61f20f69d47 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860" status: 200 len: 1521 microversion: 2.1 time: 0.214631 Jun 16 12:27:48.065797 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 85/176] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:47 2022] GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860 => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:48.068122 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6f89ed9e-16f6-4ca0-9ddb-7a8f6eaa3efd tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682" status: 200 len: 1365 microversion: 2.1 time: 0.213184 Jun 16 12:27:48.068681 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 92/177] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:47 2022] GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682 => generated 1365 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:27:48.111605 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f0e008a8-43f4-4160-990e-fad5cd4290ed tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:48.112133 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f0e008a8-43f4-4160-990e-fad5cd4290ed tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:48.113686 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7a929e93-11ce-43cd-bcf6-33d03332a488 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:48.114324 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7a929e93-11ce-43cd-bcf6-33d03332a488 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] [instance: c72b39de-9695-4833-8a7a-76af4eaa33d4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:48.118155 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f0e008a8-43f4-4160-990e-fad5cd4290ed tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:48.118600 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f0e008a8-43f4-4160-990e-fad5cd4290ed tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:48.119358 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f0e008a8-43f4-4160-990e-fad5cd4290ed tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:48.119788 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f0e008a8-43f4-4160-990e-fad5cd4290ed tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:48.120324 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7a929e93-11ce-43cd-bcf6-33d03332a488 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:48.120768 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7a929e93-11ce-43cd-bcf6-33d03332a488 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:48.121546 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7a929e93-11ce-43cd-bcf6-33d03332a488 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:48.122010 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7a929e93-11ce-43cd-bcf6-33d03332a488 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:48.676213 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f0e008a8-43f4-4160-990e-fad5cd4290ed tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:48.685079 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f0e008a8-43f4-4160-990e-fad5cd4290ed tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:48.687698 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f0e008a8-43f4-4160-990e-fad5cd4290ed tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:48.688840 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f0e008a8-43f4-4160-990e-fad5cd4290ed tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1407 microversion: 2.20 time: 0.581366 Jun 16 12:27:48.689553 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 86/178] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:27:48 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1407 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 12:27:48.704266 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7a929e93-11ce-43cd-bcf6-33d03332a488 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf22beda54e24b878e514304e7a62b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66000602298490b9e76d8138fdb825b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:48.712891 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7a929e93-11ce-43cd-bcf6-33d03332a488 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] 10.222.0.45 "GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4" status: 200 len: 1315 microversion: 2.1 time: 0.603261 Jun 16 12:27:48.726024 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 93/179] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:48 2022] GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4 => generated 1315 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:27:49.082780 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7bd307b2-19a6-4b40-9456-833fb7b7bc38 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:49.083438 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7bd307b2-19a6-4b40-9456-833fb7b7bc38 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: 331b2de0-3963-4186-bc19-f2fe2e97d860] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:49.084354 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6ed34e0a-a440-47cb-a4b9-9202bbfe0244 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:49.085056 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6ed34e0a-a440-47cb-a4b9-9202bbfe0244 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: ddba5ba6-d9f4-493c-b15b-9443a5426682] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:49.089403 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7bd307b2-19a6-4b40-9456-833fb7b7bc38 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:49.089853 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7bd307b2-19a6-4b40-9456-833fb7b7bc38 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:49.090644 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7bd307b2-19a6-4b40-9456-833fb7b7bc38 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:49.091130 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7bd307b2-19a6-4b40-9456-833fb7b7bc38 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:49.091532 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6ed34e0a-a440-47cb-a4b9-9202bbfe0244 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:49.092477 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6ed34e0a-a440-47cb-a4b9-9202bbfe0244 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:49.092876 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6ed34e0a-a440-47cb-a4b9-9202bbfe0244 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:49.093308 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6ed34e0a-a440-47cb-a4b9-9202bbfe0244 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:49.288008 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7bd307b2-19a6-4b40-9456-833fb7b7bc38 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:49.289431 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6ed34e0a-a440-47cb-a4b9-9202bbfe0244 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:49.296945 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7bd307b2-19a6-4b40-9456-833fb7b7bc38 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860" status: 200 len: 1521 microversion: 2.1 time: 0.218056 Jun 16 12:27:49.297717 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 87/180] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:49 2022] GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860 => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:49.306537 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6ed34e0a-a440-47cb-a4b9-9202bbfe0244 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682" status: 200 len: 1365 microversion: 2.1 time: 0.219982 Jun 16 12:27:49.306537 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 94/181] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:49 2022] GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682 => generated 1365 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:27:49.707110 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a5357815-888e-426f-b539-065199e66fbb tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:49.707820 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a5357815-888e-426f-b539-065199e66fbb tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:49.714200 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a5357815-888e-426f-b539-065199e66fbb tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:49.714745 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a5357815-888e-426f-b539-065199e66fbb tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:49.715617 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a5357815-888e-426f-b539-065199e66fbb tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:49.716145 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a5357815-888e-426f-b539-065199e66fbb tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:49.730330 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-99f1de98-660a-4b86-b56f-aaf02e84c2cb tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:49.730930 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-99f1de98-660a-4b86-b56f-aaf02e84c2cb tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] [instance: c72b39de-9695-4833-8a7a-76af4eaa33d4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:49.738822 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-99f1de98-660a-4b86-b56f-aaf02e84c2cb tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:49.739544 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-99f1de98-660a-4b86-b56f-aaf02e84c2cb tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:49.740349 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-99f1de98-660a-4b86-b56f-aaf02e84c2cb tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:49.740787 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-99f1de98-660a-4b86-b56f-aaf02e84c2cb tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:49.942805 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a5357815-888e-426f-b539-065199e66fbb tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:49.956752 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a5357815-888e-426f-b539-065199e66fbb tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:49.958964 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a5357815-888e-426f-b539-065199e66fbb tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:49.960198 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a5357815-888e-426f-b539-065199e66fbb tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1597 microversion: 2.20 time: 0.257266 Jun 16 12:27:49.961277 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 95/182] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:27:49 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1597 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:27:49.964948 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-99f1de98-660a-4b86-b56f-aaf02e84c2cb tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf22beda54e24b878e514304e7a62b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66000602298490b9e76d8138fdb825b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:49.972768 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-99f1de98-660a-4b86-b56f-aaf02e84c2cb tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] 10.222.0.45 "GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4" status: 200 len: 1315 microversion: 2.1 time: 0.246114 Jun 16 12:27:49.973407 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 88/183] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:49 2022] GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4 => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:49.987435 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-28ed5f65-06e9-4f4e-a6eb-0d46a5708519 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:49.987821 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-28ed5f65-06e9-4f4e-a6eb-0d46a5708519 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:49.993673 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-28ed5f65-06e9-4f4e-a6eb-0d46a5708519 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:49.994149 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-28ed5f65-06e9-4f4e-a6eb-0d46a5708519 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:49.994977 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-28ed5f65-06e9-4f4e-a6eb-0d46a5708519 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:49.995409 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-28ed5f65-06e9-4f4e-a6eb-0d46a5708519 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:50.116516 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-28ed5f65-06e9-4f4e-a6eb-0d46a5708519 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.133437 Jun 16 12:27:50.117366 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 96/184] 10.222.0.45 () {60 vars in 1315 bytes} [Thu Jun 16 12:27:49 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df/os-interface => generated 284 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 12:27:50.316344 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2ba5c0c3-22e6-49b6-a23a-35031f984645 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:50.317017 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2ba5c0c3-22e6-49b6-a23a-35031f984645 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: 331b2de0-3963-4186-bc19-f2fe2e97d860] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:50.320163 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8254be35-25db-42bc-81aa-a3052f78d477 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:50.321652 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8254be35-25db-42bc-81aa-a3052f78d477 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: ddba5ba6-d9f4-493c-b15b-9443a5426682] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:50.325691 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2ba5c0c3-22e6-49b6-a23a-35031f984645 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:50.326216 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2ba5c0c3-22e6-49b6-a23a-35031f984645 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:50.327003 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2ba5c0c3-22e6-49b6-a23a-35031f984645 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:50.328527 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2ba5c0c3-22e6-49b6-a23a-35031f984645 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:50.331850 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8254be35-25db-42bc-81aa-a3052f78d477 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:50.332804 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8254be35-25db-42bc-81aa-a3052f78d477 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:50.333796 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8254be35-25db-42bc-81aa-a3052f78d477 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:50.334250 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8254be35-25db-42bc-81aa-a3052f78d477 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:50.551267 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8254be35-25db-42bc-81aa-a3052f78d477 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:50.557483 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2ba5c0c3-22e6-49b6-a23a-35031f984645 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:50.559801 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8254be35-25db-42bc-81aa-a3052f78d477 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682" status: 200 len: 1365 microversion: 2.1 time: 0.245390 Jun 16 12:27:50.561911 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 97/185] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:50 2022] GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682 => generated 1365 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:50.572048 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2ba5c0c3-22e6-49b6-a23a-35031f984645 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860" status: 200 len: 1521 microversion: 2.1 time: 0.261859 Jun 16 12:27:50.573483 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 89/186] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:50 2022] GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860 => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:50.989748 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6de444d9-88dc-4b33-b152-fe4d578bdfb2 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:50.990286 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6de444d9-88dc-4b33-b152-fe4d578bdfb2 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] [instance: c72b39de-9695-4833-8a7a-76af4eaa33d4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:50.996292 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6de444d9-88dc-4b33-b152-fe4d578bdfb2 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:50.996734 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6de444d9-88dc-4b33-b152-fe4d578bdfb2 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:50.997479 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6de444d9-88dc-4b33-b152-fe4d578bdfb2 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:50.998616 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6de444d9-88dc-4b33-b152-fe4d578bdfb2 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:51.168519 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6de444d9-88dc-4b33-b152-fe4d578bdfb2 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf22beda54e24b878e514304e7a62b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66000602298490b9e76d8138fdb825b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:51.177827 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6de444d9-88dc-4b33-b152-fe4d578bdfb2 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] 10.222.0.45 "GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4" status: 200 len: 1315 microversion: 2.1 time: 0.191919 Jun 16 12:27:51.186903 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 98/187] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:50 2022] GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4 => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:51.558216 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-c3dcddf3-51b1-4784-826a-e6d57120e788 req-306186e4-6533-450b-927a-643d988c6177 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8528919e-1e7a-4807-9b11-ae225e65d4df", "tag": "ee66a439-1483-44c8-a66e-9b4920bb00e9"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:27:51.567401 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-c3dcddf3-51b1-4784-826a-e6d57120e788 req-306186e4-6533-450b-927a-643d988c6177 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:51.567747 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-c3dcddf3-51b1-4784-826a-e6d57120e788 req-306186e4-6533-450b-927a-643d988c6177 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:51.579741 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-c3dcddf3-51b1-4784-826a-e6d57120e788 req-306186e4-6533-450b-927a-643d988c6177 service nova] Creating event network-changed:ee66a439-1483-44c8-a66e-9b4920bb00e9 for instance 8528919e-1e7a-4807-9b11-ae225e65d4df on hv-cinder-84614 Jun 16 12:27:51.581215 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9664a222-c84b-4648-949f-7fd4e322b0d1 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:51.582538 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9664a222-c84b-4648-949f-7fd4e322b0d1 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: ddba5ba6-d9f4-493c-b15b-9443a5426682] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:51.587075 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-c3dcddf3-51b1-4784-826a-e6d57120e788 req-306186e4-6533-450b-927a-643d988c6177 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033494 Jun 16 12:27:51.588078 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 90/188] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:27:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 12:27:51.592129 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9664a222-c84b-4648-949f-7fd4e322b0d1 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:51.592962 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9664a222-c84b-4648-949f-7fd4e322b0d1 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:51.593907 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9664a222-c84b-4648-949f-7fd4e322b0d1 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:51.594578 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9664a222-c84b-4648-949f-7fd4e322b0d1 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:51.599077 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4c3bd72c-f56c-4475-9c7a-97ad29af2bb3 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:51.599977 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4c3bd72c-f56c-4475-9c7a-97ad29af2bb3 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: 331b2de0-3963-4186-bc19-f2fe2e97d860] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:51.606979 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4c3bd72c-f56c-4475-9c7a-97ad29af2bb3 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:51.608300 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4c3bd72c-f56c-4475-9c7a-97ad29af2bb3 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:51.610176 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4c3bd72c-f56c-4475-9c7a-97ad29af2bb3 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:51.610815 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4c3bd72c-f56c-4475-9c7a-97ad29af2bb3 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:51.797721 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9664a222-c84b-4648-949f-7fd4e322b0d1 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:51.812354 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9664a222-c84b-4648-949f-7fd4e322b0d1 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682" status: 200 len: 1365 microversion: 2.1 time: 0.237335 Jun 16 12:27:51.813127 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 99/189] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:51 2022] GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682 => generated 1365 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:51.834378 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4c3bd72c-f56c-4475-9c7a-97ad29af2bb3 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:51.842280 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4c3bd72c-f56c-4475-9c7a-97ad29af2bb3 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860" status: 200 len: 1521 microversion: 2.1 time: 0.247604 Jun 16 12:27:51.843260 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 91/190] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:51 2022] GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860 => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:52.197057 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a45b1da6-f242-451c-89c8-3105f595ef51 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:52.197672 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a45b1da6-f242-451c-89c8-3105f595ef51 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] [instance: c72b39de-9695-4833-8a7a-76af4eaa33d4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:52.205061 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a45b1da6-f242-451c-89c8-3105f595ef51 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:52.205705 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a45b1da6-f242-451c-89c8-3105f595ef51 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:52.206528 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a45b1da6-f242-451c-89c8-3105f595ef51 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:52.206965 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a45b1da6-f242-451c-89c8-3105f595ef51 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:52.349619 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a45b1da6-f242-451c-89c8-3105f595ef51 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf22beda54e24b878e514304e7a62b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66000602298490b9e76d8138fdb825b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:52.363254 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a45b1da6-f242-451c-89c8-3105f595ef51 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] 10.222.0.45 "GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4" status: 200 len: 1315 microversion: 2.1 time: 0.170541 Jun 16 12:27:52.364187 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 100/191] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:52 2022] GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:52.828846 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b08e1e61-4e8b-4c00-adaa-8f064526cdee tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:52.829524 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b08e1e61-4e8b-4c00-adaa-8f064526cdee tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: ddba5ba6-d9f4-493c-b15b-9443a5426682] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:52.836551 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b08e1e61-4e8b-4c00-adaa-8f064526cdee tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:52.837412 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b08e1e61-4e8b-4c00-adaa-8f064526cdee tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:52.838515 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b08e1e61-4e8b-4c00-adaa-8f064526cdee tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:52.839139 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b08e1e61-4e8b-4c00-adaa-8f064526cdee tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:52.860346 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-91991cdc-6a70-4339-8d81-d7d0807d8740 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:52.861097 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-91991cdc-6a70-4339-8d81-d7d0807d8740 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: 331b2de0-3963-4186-bc19-f2fe2e97d860] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:52.870871 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-91991cdc-6a70-4339-8d81-d7d0807d8740 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:52.871321 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-91991cdc-6a70-4339-8d81-d7d0807d8740 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:52.872092 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-91991cdc-6a70-4339-8d81-d7d0807d8740 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:52.872531 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-91991cdc-6a70-4339-8d81-d7d0807d8740 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:53.074646 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b08e1e61-4e8b-4c00-adaa-8f064526cdee tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:53.089204 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b08e1e61-4e8b-4c00-adaa-8f064526cdee tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682" status: 200 len: 1365 microversion: 2.1 time: 0.264452 Jun 16 12:27:53.099894 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 92/192] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:52 2022] GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682 => generated 1365 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:53.105393 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-91991cdc-6a70-4339-8d81-d7d0807d8740 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:53.115417 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-91991cdc-6a70-4339-8d81-d7d0807d8740 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860" status: 200 len: 1521 microversion: 2.1 time: 0.259686 Jun 16 12:27:53.115983 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 101/193] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:52 2022] GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860 => generated 1521 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:53.380068 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5b93b298-b057-48f0-9606-938273bdf658 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:53.380670 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5b93b298-b057-48f0-9606-938273bdf658 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] [instance: c72b39de-9695-4833-8a7a-76af4eaa33d4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:53.386915 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5b93b298-b057-48f0-9606-938273bdf658 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:53.387354 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5b93b298-b057-48f0-9606-938273bdf658 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:53.388094 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5b93b298-b057-48f0-9606-938273bdf658 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:53.389081 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5b93b298-b057-48f0-9606-938273bdf658 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:53.517908 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5b93b298-b057-48f0-9606-938273bdf658 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf22beda54e24b878e514304e7a62b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66000602298490b9e76d8138fdb825b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:53.525451 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5b93b298-b057-48f0-9606-938273bdf658 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] 10.222.0.45 "GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4" status: 200 len: 1315 microversion: 2.1 time: 0.149521 Jun 16 12:27:53.526082 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 93/194] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:53 2022] GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:54.106604 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1b4ca33c-c2ca-48d0-8bd7-d9f82bbfa683 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:54.108529 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1b4ca33c-c2ca-48d0-8bd7-d9f82bbfa683 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: ddba5ba6-d9f4-493c-b15b-9443a5426682] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:54.113997 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1b4ca33c-c2ca-48d0-8bd7-d9f82bbfa683 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:54.114471 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1b4ca33c-c2ca-48d0-8bd7-d9f82bbfa683 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:54.115220 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1b4ca33c-c2ca-48d0-8bd7-d9f82bbfa683 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:54.115646 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1b4ca33c-c2ca-48d0-8bd7-d9f82bbfa683 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:54.132548 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ea431ab8-6247-40d4-87c6-80f68ced3cbf tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:54.133158 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ea431ab8-6247-40d4-87c6-80f68ced3cbf tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: 331b2de0-3963-4186-bc19-f2fe2e97d860] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:54.139240 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ea431ab8-6247-40d4-87c6-80f68ced3cbf tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:54.139688 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ea431ab8-6247-40d4-87c6-80f68ced3cbf tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:54.140459 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ea431ab8-6247-40d4-87c6-80f68ced3cbf tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:54.140877 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ea431ab8-6247-40d4-87c6-80f68ced3cbf tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:54.320755 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1b4ca33c-c2ca-48d0-8bd7-d9f82bbfa683 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:54.324011 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ea431ab8-6247-40d4-87c6-80f68ced3cbf tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:54.328375 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1b4ca33c-c2ca-48d0-8bd7-d9f82bbfa683 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682" status: 200 len: 1365 microversion: 2.1 time: 0.225515 Jun 16 12:27:54.329016 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 102/195] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:54 2022] GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682 => generated 1365 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:54.331520 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ea431ab8-6247-40d4-87c6-80f68ced3cbf tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860" status: 200 len: 1521 microversion: 2.1 time: 0.202842 Jun 16 12:27:54.332076 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 94/196] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:54 2022] GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860 => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:27:54.542321 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-577b582d-f71d-4bd5-acb8-403db64f58f7 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:54.542859 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-577b582d-f71d-4bd5-acb8-403db64f58f7 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] [instance: c72b39de-9695-4833-8a7a-76af4eaa33d4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:54.549353 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-577b582d-f71d-4bd5-acb8-403db64f58f7 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:54.549801 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-577b582d-f71d-4bd5-acb8-403db64f58f7 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:54.550599 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-577b582d-f71d-4bd5-acb8-403db64f58f7 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:54.551031 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-577b582d-f71d-4bd5-acb8-403db64f58f7 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:54.678994 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-577b582d-f71d-4bd5-acb8-403db64f58f7 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf22beda54e24b878e514304e7a62b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66000602298490b9e76d8138fdb825b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:54.686461 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-577b582d-f71d-4bd5-acb8-403db64f58f7 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] 10.222.0.45 "GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4" status: 200 len: 1315 microversion: 2.1 time: 0.148003 Jun 16 12:27:54.687047 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 103/197] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:54 2022] GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:55.345212 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-fc4c7726-faaa-4695-b71b-75fc38dc76b0 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:55.345858 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-fc4c7726-faaa-4695-b71b-75fc38dc76b0 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: ddba5ba6-d9f4-493c-b15b-9443a5426682] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:55.348183 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7d303e12-63c4-459d-be92-2b38b3a6808a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:55.348795 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7d303e12-63c4-459d-be92-2b38b3a6808a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: 331b2de0-3963-4186-bc19-f2fe2e97d860] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:55.352208 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fc4c7726-faaa-4695-b71b-75fc38dc76b0 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:55.352664 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fc4c7726-faaa-4695-b71b-75fc38dc76b0 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:55.353442 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fc4c7726-faaa-4695-b71b-75fc38dc76b0 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:55.353888 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fc4c7726-faaa-4695-b71b-75fc38dc76b0 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:55.355191 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7d303e12-63c4-459d-be92-2b38b3a6808a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:55.355191 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7d303e12-63c4-459d-be92-2b38b3a6808a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:55.355956 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7d303e12-63c4-459d-be92-2b38b3a6808a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:55.356377 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7d303e12-63c4-459d-be92-2b38b3a6808a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:55.550010 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-fc4c7726-faaa-4695-b71b-75fc38dc76b0 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:55.554080 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7d303e12-63c4-459d-be92-2b38b3a6808a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:55.557395 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-fc4c7726-faaa-4695-b71b-75fc38dc76b0 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682" status: 200 len: 1365 microversion: 2.1 time: 0.216839 Jun 16 12:27:55.558010 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 95/198] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:55 2022] GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682 => generated 1365 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:27:55.562612 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7d303e12-63c4-459d-be92-2b38b3a6808a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860" status: 200 len: 1521 microversion: 2.1 time: 0.218135 Jun 16 12:27:55.563193 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 104/199] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:55 2022] GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860 => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:27:55.703119 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f51c659b-7505-4fe7-b79c-94d4af13d977 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:55.703728 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f51c659b-7505-4fe7-b79c-94d4af13d977 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] [instance: c72b39de-9695-4833-8a7a-76af4eaa33d4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:55.709792 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f51c659b-7505-4fe7-b79c-94d4af13d977 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:55.710327 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f51c659b-7505-4fe7-b79c-94d4af13d977 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:55.711036 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f51c659b-7505-4fe7-b79c-94d4af13d977 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:55.711469 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f51c659b-7505-4fe7-b79c-94d4af13d977 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:55.836537 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f51c659b-7505-4fe7-b79c-94d4af13d977 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf22beda54e24b878e514304e7a62b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66000602298490b9e76d8138fdb825b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:55.844516 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f51c659b-7505-4fe7-b79c-94d4af13d977 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] 10.222.0.45 "GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4" status: 200 len: 1315 microversion: 2.1 time: 0.145435 Jun 16 12:27:55.845078 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 96/200] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:55 2022] GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4 => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:56.574493 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3cffc5ce-dfcf-4679-9ff5-04c8e9dea8d8 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:56.575098 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3cffc5ce-dfcf-4679-9ff5-04c8e9dea8d8 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: ddba5ba6-d9f4-493c-b15b-9443a5426682] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:56.580843 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-00190cf4-7e31-425b-b281-3628fa17cf3e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:56.581390 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-00190cf4-7e31-425b-b281-3628fa17cf3e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: 331b2de0-3963-4186-bc19-f2fe2e97d860] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:56.582518 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3cffc5ce-dfcf-4679-9ff5-04c8e9dea8d8 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:56.582969 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3cffc5ce-dfcf-4679-9ff5-04c8e9dea8d8 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:56.583725 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3cffc5ce-dfcf-4679-9ff5-04c8e9dea8d8 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:56.584152 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3cffc5ce-dfcf-4679-9ff5-04c8e9dea8d8 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:56.587327 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-00190cf4-7e31-425b-b281-3628fa17cf3e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:56.587779 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-00190cf4-7e31-425b-b281-3628fa17cf3e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:56.588160 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:56.588780 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-00190cf4-7e31-425b-b281-3628fa17cf3e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:56.588982 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-00190cf4-7e31-425b-b281-3628fa17cf3e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:56.779186 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3cffc5ce-dfcf-4679-9ff5-04c8e9dea8d8 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:56.783874 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-00190cf4-7e31-425b-b281-3628fa17cf3e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:56.786909 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3cffc5ce-dfcf-4679-9ff5-04c8e9dea8d8 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682" status: 200 len: 1365 microversion: 2.1 time: 0.216216 Jun 16 12:27:56.787902 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 105/201] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:56 2022] GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682 => generated 1365 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:56.791609 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-00190cf4-7e31-425b-b281-3628fa17cf3e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860" status: 200 len: 1521 microversion: 2.1 time: 0.214911 Jun 16 12:27:56.792158 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 97/202] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:56 2022] GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860 => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:27:56.861606 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b7a17552-8b4c-43e3-b9a6-e04245adbb3e tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:56.862168 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b7a17552-8b4c-43e3-b9a6-e04245adbb3e tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] [instance: c72b39de-9695-4833-8a7a-76af4eaa33d4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:56.868120 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b7a17552-8b4c-43e3-b9a6-e04245adbb3e tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:56.868570 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b7a17552-8b4c-43e3-b9a6-e04245adbb3e tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:56.869329 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b7a17552-8b4c-43e3-b9a6-e04245adbb3e tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:56.869766 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b7a17552-8b4c-43e3-b9a6-e04245adbb3e tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:57.002336 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b7a17552-8b4c-43e3-b9a6-e04245adbb3e tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf22beda54e24b878e514304e7a62b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66000602298490b9e76d8138fdb825b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:57.009717 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b7a17552-8b4c-43e3-b9a6-e04245adbb3e tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] 10.222.0.45 "GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4" status: 200 len: 1315 microversion: 2.1 time: 0.152642 Jun 16 12:27:57.010313 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 106/203] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:56 2022] GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:57.804536 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1f6a50ff-d820-4585-9d70-af99c956486b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:57.805143 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1f6a50ff-d820-4585-9d70-af99c956486b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: ddba5ba6-d9f4-493c-b15b-9443a5426682] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:57.808529 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-87c885cb-a969-496f-90b2-77492aeaf735 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:57.809174 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-87c885cb-a969-496f-90b2-77492aeaf735 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: 331b2de0-3963-4186-bc19-f2fe2e97d860] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:57.811342 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1f6a50ff-d820-4585-9d70-af99c956486b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:57.811795 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1f6a50ff-d820-4585-9d70-af99c956486b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:57.812571 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1f6a50ff-d820-4585-9d70-af99c956486b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:57.812985 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1f6a50ff-d820-4585-9d70-af99c956486b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:57.815380 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-87c885cb-a969-496f-90b2-77492aeaf735 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:57.815859 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-87c885cb-a969-496f-90b2-77492aeaf735 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:57.816627 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-87c885cb-a969-496f-90b2-77492aeaf735 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:57.817064 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-87c885cb-a969-496f-90b2-77492aeaf735 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:58.003294 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1f6a50ff-d820-4585-9d70-af99c956486b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:58.010136 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-87c885cb-a969-496f-90b2-77492aeaf735 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:58.010674 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1f6a50ff-d820-4585-9d70-af99c956486b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682" status: 200 len: 1365 microversion: 2.1 time: 0.209993 Jun 16 12:27:58.011243 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 98/204] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:57 2022] GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682 => generated 1365 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:58.018374 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-87c885cb-a969-496f-90b2-77492aeaf735 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860" status: 200 len: 1521 microversion: 2.1 time: 0.213627 Jun 16 12:27:58.019009 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 107/205] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:57 2022] GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860 => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:27:58.030465 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4f4aa63c-2ffc-4295-ae61-a6ffd19413d3 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:58.031619 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4f4aa63c-2ffc-4295-ae61-a6ffd19413d3 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] [instance: c72b39de-9695-4833-8a7a-76af4eaa33d4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:58.039388 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4f4aa63c-2ffc-4295-ae61-a6ffd19413d3 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:58.039828 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4f4aa63c-2ffc-4295-ae61-a6ffd19413d3 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:58.040570 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4f4aa63c-2ffc-4295-ae61-a6ffd19413d3 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:58.040994 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4f4aa63c-2ffc-4295-ae61-a6ffd19413d3 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:58.180581 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4f4aa63c-2ffc-4295-ae61-a6ffd19413d3 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf22beda54e24b878e514304e7a62b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66000602298490b9e76d8138fdb825b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:58.183776 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:58.192401 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4f4aa63c-2ffc-4295-ae61-a6ffd19413d3 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] 10.222.0.45 "GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4" status: 200 len: 1315 microversion: 2.1 time: 0.169577 Jun 16 12:27:58.193001 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 99/206] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:58 2022] GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:59.027413 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-11468c09-5d4b-4780-b349-d151924daaa9 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:59.028034 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-11468c09-5d4b-4780-b349-d151924daaa9 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: ddba5ba6-d9f4-493c-b15b-9443a5426682] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:59.034420 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-11468c09-5d4b-4780-b349-d151924daaa9 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:59.034877 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-11468c09-5d4b-4780-b349-d151924daaa9 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:59.035938 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-11468c09-5d4b-4780-b349-d151924daaa9 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:59.036379 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-11468c09-5d4b-4780-b349-d151924daaa9 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:59.043316 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a64df7ab-2545-4f4a-84e7-3f5201857105 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:59.044064 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a64df7ab-2545-4f4a-84e7-3f5201857105 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: 331b2de0-3963-4186-bc19-f2fe2e97d860] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:59.051799 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a64df7ab-2545-4f4a-84e7-3f5201857105 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:59.052225 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a64df7ab-2545-4f4a-84e7-3f5201857105 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:59.052988 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a64df7ab-2545-4f4a-84e7-3f5201857105 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:59.053416 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a64df7ab-2545-4f4a-84e7-3f5201857105 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:59.251649 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-11468c09-5d4b-4780-b349-d151924daaa9 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:59.255744 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a64df7ab-2545-4f4a-84e7-3f5201857105 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:59.260833 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-11468c09-5d4b-4780-b349-d151924daaa9 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682" status: 200 len: 1365 microversion: 2.1 time: 0.237270 Jun 16 12:27:59.271868 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 108/207] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:59 2022] GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682 => generated 1365 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:27:59.272743 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a64df7ab-2545-4f4a-84e7-3f5201857105 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860" status: 200 len: 1521 microversion: 2.1 time: 0.233103 Jun 16 12:27:59.273445 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 100/208] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:59 2022] GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860 => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:27:59.286713 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f4ba61a7-eabe-4aca-80e6-1de1b7cc6099 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:27:59.287470 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f4ba61a7-eabe-4aca-80e6-1de1b7cc6099 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] [instance: c72b39de-9695-4833-8a7a-76af4eaa33d4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:27:59.294767 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f4ba61a7-eabe-4aca-80e6-1de1b7cc6099 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:59.295928 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f4ba61a7-eabe-4aca-80e6-1de1b7cc6099 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:59.297386 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f4ba61a7-eabe-4aca-80e6-1de1b7cc6099 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:27:59.298114 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f4ba61a7-eabe-4aca-80e6-1de1b7cc6099 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:27:59.447252 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f4ba61a7-eabe-4aca-80e6-1de1b7cc6099 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf22beda54e24b878e514304e7a62b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66000602298490b9e76d8138fdb825b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:27:59.456861 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f4ba61a7-eabe-4aca-80e6-1de1b7cc6099 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] 10.222.0.45 "GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4" status: 200 len: 1501 microversion: 2.1 time: 0.183527 Jun 16 12:27:59.471388 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 109/209] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:27:59 2022] GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4 => generated 1501 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:28:00.278950 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4628872e-5568-4b1a-9397-9e11e0b2378e tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:00.281110 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4628872e-5568-4b1a-9397-9e11e0b2378e tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: ddba5ba6-d9f4-493c-b15b-9443a5426682] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:00.287713 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4628872e-5568-4b1a-9397-9e11e0b2378e tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:00.288512 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4628872e-5568-4b1a-9397-9e11e0b2378e tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:00.289292 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4628872e-5568-4b1a-9397-9e11e0b2378e tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:00.289725 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4628872e-5568-4b1a-9397-9e11e0b2378e tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:00.290642 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-81bb21f9-d4aa-42a2-bc60-c16bdeacf4c1 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:00.291860 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-81bb21f9-d4aa-42a2-bc60-c16bdeacf4c1 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: 331b2de0-3963-4186-bc19-f2fe2e97d860] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:00.298272 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-81bb21f9-d4aa-42a2-bc60-c16bdeacf4c1 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:00.299003 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-81bb21f9-d4aa-42a2-bc60-c16bdeacf4c1 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:00.299834 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-81bb21f9-d4aa-42a2-bc60-c16bdeacf4c1 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:00.300267 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-81bb21f9-d4aa-42a2-bc60-c16bdeacf4c1 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:00.499056 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4628872e-5568-4b1a-9397-9e11e0b2378e tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:00.510219 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-81bb21f9-d4aa-42a2-bc60-c16bdeacf4c1 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:00.516167 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4628872e-5568-4b1a-9397-9e11e0b2378e tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682" status: 200 len: 1556 microversion: 2.1 time: 0.240911 Jun 16 12:28:00.516758 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 101/210] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:00 2022] GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682 => generated 1556 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:28:00.518891 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-81bb21f9-d4aa-42a2-bc60-c16bdeacf4c1 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860" status: 200 len: 1521 microversion: 2.1 time: 0.232418 Jun 16 12:28:00.519668 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 110/211] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:00 2022] GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860 => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:28:00.533633 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-14341abb-f308-45aa-992a-d922319ca339 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:00.534148 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-14341abb-f308-45aa-992a-d922319ca339 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: ddba5ba6-d9f4-493c-b15b-9443a5426682] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:00.540238 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-14341abb-f308-45aa-992a-d922319ca339 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:00.540684 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-14341abb-f308-45aa-992a-d922319ca339 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:00.541442 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-14341abb-f308-45aa-992a-d922319ca339 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:00.541893 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-14341abb-f308-45aa-992a-d922319ca339 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:00.618471 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-14341abb-f308-45aa-992a-d922319ca339 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089342 Jun 16 12:28:00.619481 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 102/212] 10.222.0.45 () {58 vars in 1274 bytes} [Thu Jun 16 12:28:00 2022] GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:28:01.536370 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b7da6bd0-2c5b-443b-853b-18f5f63b9280 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:01.537072 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b7da6bd0-2c5b-443b-853b-18f5f63b9280 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: 331b2de0-3963-4186-bc19-f2fe2e97d860] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:01.544833 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b7da6bd0-2c5b-443b-853b-18f5f63b9280 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:01.546318 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b7da6bd0-2c5b-443b-853b-18f5f63b9280 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:01.547335 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b7da6bd0-2c5b-443b-853b-18f5f63b9280 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:01.548237 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b7da6bd0-2c5b-443b-853b-18f5f63b9280 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:01.594826 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-0197da06-f622-4508-b53f-b7e9ac461551 req-4870e4cd-fcbc-454c-aa01-97c05e45b134 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddba5ba6-d9f4-493c-b15b-9443a5426682", "tag": "80765d24-d4d2-42f5-b6b1-6bb0e8d83b1d"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:28:01.610158 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-0197da06-f622-4508-b53f-b7e9ac461551 req-4870e4cd-fcbc-454c-aa01-97c05e45b134 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:01.611073 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-0197da06-f622-4508-b53f-b7e9ac461551 req-4870e4cd-fcbc-454c-aa01-97c05e45b134 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:01.631551 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-0197da06-f622-4508-b53f-b7e9ac461551 req-4870e4cd-fcbc-454c-aa01-97c05e45b134 service nova] Creating event network-changed:80765d24-d4d2-42f5-b6b1-6bb0e8d83b1d for instance ddba5ba6-d9f4-493c-b15b-9443a5426682 on hv-cinder-84614 Jun 16 12:28:01.638150 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-0197da06-f622-4508-b53f-b7e9ac461551 req-4870e4cd-fcbc-454c-aa01-97c05e45b134 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047854 Jun 16 12:28:01.638881 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 103/213] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:28:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jun 16 12:28:01.735027 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b7da6bd0-2c5b-443b-853b-18f5f63b9280 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:01.743182 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b7da6bd0-2c5b-443b-853b-18f5f63b9280 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860" status: 200 len: 1521 microversion: 2.1 time: 0.210857 Jun 16 12:28:01.744179 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 111/214] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:01 2022] GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860 => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:28:02.762031 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-42dfd233-5789-4f61-9bb9-61b3d003216a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:02.764285 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-42dfd233-5789-4f61-9bb9-61b3d003216a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: 331b2de0-3963-4186-bc19-f2fe2e97d860] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:02.770699 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-42dfd233-5789-4f61-9bb9-61b3d003216a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:02.771148 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-42dfd233-5789-4f61-9bb9-61b3d003216a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:02.771970 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-42dfd233-5789-4f61-9bb9-61b3d003216a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:02.772426 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-42dfd233-5789-4f61-9bb9-61b3d003216a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:02.919759 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-42dfd233-5789-4f61-9bb9-61b3d003216a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:02.927245 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-42dfd233-5789-4f61-9bb9-61b3d003216a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860" status: 200 len: 1521 microversion: 2.1 time: 0.169472 Jun 16 12:28:02.927942 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 104/215] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:02 2022] GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:28:03.944259 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8eba4ffb-ebfd-42a3-a2c2-aeedfa9df773 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:03.944874 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8eba4ffb-ebfd-42a3-a2c2-aeedfa9df773 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: 331b2de0-3963-4186-bc19-f2fe2e97d860] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:03.950931 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8eba4ffb-ebfd-42a3-a2c2-aeedfa9df773 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:03.951439 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8eba4ffb-ebfd-42a3-a2c2-aeedfa9df773 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:03.952189 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8eba4ffb-ebfd-42a3-a2c2-aeedfa9df773 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:03.952618 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8eba4ffb-ebfd-42a3-a2c2-aeedfa9df773 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:04.078317 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8eba4ffb-ebfd-42a3-a2c2-aeedfa9df773 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:04.085655 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8eba4ffb-ebfd-42a3-a2c2-aeedfa9df773 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860" status: 200 len: 1521 microversion: 2.1 time: 0.145190 Jun 16 12:28:04.086248 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 112/216] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:03 2022] GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860 => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:28:05.102390 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f6aede64-560f-4ca3-9310-905b746b5f04 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:05.103659 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f6aede64-560f-4ca3-9310-905b746b5f04 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: 331b2de0-3963-4186-bc19-f2fe2e97d860] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:05.109683 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f6aede64-560f-4ca3-9310-905b746b5f04 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:05.110156 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f6aede64-560f-4ca3-9310-905b746b5f04 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:05.110912 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f6aede64-560f-4ca3-9310-905b746b5f04 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:05.111346 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f6aede64-560f-4ca3-9310-905b746b5f04 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:05.643233 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f6aede64-560f-4ca3-9310-905b746b5f04 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:05.650764 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f6aede64-560f-4ca3-9310-905b746b5f04 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860" status: 200 len: 1521 microversion: 2.1 time: 0.552092 Jun 16 12:28:05.651339 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 105/217] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:05 2022] GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860 => generated 1521 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:28:06.668599 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c3ecf003-3361-46aa-9d4e-8d8726c3e613 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:06.669208 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c3ecf003-3361-46aa-9d4e-8d8726c3e613 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: 331b2de0-3963-4186-bc19-f2fe2e97d860] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:06.675912 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c3ecf003-3361-46aa-9d4e-8d8726c3e613 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:06.676365 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c3ecf003-3361-46aa-9d4e-8d8726c3e613 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:06.677128 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c3ecf003-3361-46aa-9d4e-8d8726c3e613 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:06.677564 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c3ecf003-3361-46aa-9d4e-8d8726c3e613 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:06.808244 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c3ecf003-3361-46aa-9d4e-8d8726c3e613 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:06.816590 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c3ecf003-3361-46aa-9d4e-8d8726c3e613 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860" status: 200 len: 1521 microversion: 2.1 time: 0.151949 Jun 16 12:28:06.817205 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 113/218] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:06 2022] GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:28:07.384301 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-69eb5bc2-2d6f-4983-a434-6c8913e455d8 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1fa3ba10-0a25-425c-bb6f-aab41c356bb2"}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:28:07.385729 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-69eb5bc2-2d6f-4983-a434-6c8913e455d8 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] [instance: c72b39de-9695-4833-8a7a-76af4eaa33d4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:07.393850 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-69eb5bc2-2d6f-4983-a434-6c8913e455d8 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:07.394342 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-69eb5bc2-2d6f-4983-a434-6c8913e455d8 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:07.395100 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-69eb5bc2-2d6f-4983-a434-6c8913e455d8 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:07.395530 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-69eb5bc2-2d6f-4983-a434-6c8913e455d8 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:07.739928 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-69eb5bc2-2d6f-4983-a434-6c8913e455d8 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] 10.222.0.45 "POST /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.358499 Jun 16 12:28:07.740834 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 106/219] 10.222.0.45 () {60 vars in 1322 bytes} [Thu Jun 16 12:28:07 2022] POST /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4/os-volume_attachments => generated 194 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:28:07.833103 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e69c2d24-8f3e-4721-927d-6b8259a4b586 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:07.833766 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e69c2d24-8f3e-4721-927d-6b8259a4b586 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: 331b2de0-3963-4186-bc19-f2fe2e97d860] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:07.839734 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e69c2d24-8f3e-4721-927d-6b8259a4b586 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:07.840443 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e69c2d24-8f3e-4721-927d-6b8259a4b586 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:07.841285 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e69c2d24-8f3e-4721-927d-6b8259a4b586 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:07.842288 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e69c2d24-8f3e-4721-927d-6b8259a4b586 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:07.967557 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e69c2d24-8f3e-4721-927d-6b8259a4b586 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:07.975020 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e69c2d24-8f3e-4721-927d-6b8259a4b586 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860" status: 200 len: 1521 microversion: 2.1 time: 0.145679 Jun 16 12:28:07.975586 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 114/220] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:07 2022] GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:28:08.993447 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0e62ab2d-5f64-4f8f-a724-b22f0768ca04 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:08.994315 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0e62ab2d-5f64-4f8f-a724-b22f0768ca04 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: 331b2de0-3963-4186-bc19-f2fe2e97d860] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:08.996255 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=76 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:28:09.008157 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0e62ab2d-5f64-4f8f-a724-b22f0768ca04 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:09.008157 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0e62ab2d-5f64-4f8f-a724-b22f0768ca04 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:09.008157 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0e62ab2d-5f64-4f8f-a724-b22f0768ca04 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:09.008157 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0e62ab2d-5f64-4f8f-a724-b22f0768ca04 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:09.155808 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0e62ab2d-5f64-4f8f-a724-b22f0768ca04 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:09.163756 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0e62ab2d-5f64-4f8f-a724-b22f0768ca04 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860" status: 200 len: 1521 microversion: 2.1 time: 0.175189 Jun 16 12:28:09.164321 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 107/221] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:08 2022] GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:28:10.180376 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1de38f1c-53ea-4564-a0cf-0c6e77b007a8 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:10.180976 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1de38f1c-53ea-4564-a0cf-0c6e77b007a8 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: 331b2de0-3963-4186-bc19-f2fe2e97d860] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:10.188663 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1de38f1c-53ea-4564-a0cf-0c6e77b007a8 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:10.189119 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1de38f1c-53ea-4564-a0cf-0c6e77b007a8 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:10.189904 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1de38f1c-53ea-4564-a0cf-0c6e77b007a8 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:10.190346 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1de38f1c-53ea-4564-a0cf-0c6e77b007a8 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:10.317062 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1de38f1c-53ea-4564-a0cf-0c6e77b007a8 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:10.324498 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1de38f1c-53ea-4564-a0cf-0c6e77b007a8 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860" status: 200 len: 1521 microversion: 2.1 time: 0.147937 Jun 16 12:28:10.325067 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 115/222] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:10 2022] GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:28:11.341385 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3ff8202d-540d-4505-bcff-64d54df5e1f9 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:11.342611 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3ff8202d-540d-4505-bcff-64d54df5e1f9 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: 331b2de0-3963-4186-bc19-f2fe2e97d860] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:11.349122 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3ff8202d-540d-4505-bcff-64d54df5e1f9 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:11.349507 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3ff8202d-540d-4505-bcff-64d54df5e1f9 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:11.350298 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3ff8202d-540d-4505-bcff-64d54df5e1f9 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:11.350733 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3ff8202d-540d-4505-bcff-64d54df5e1f9 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:11.486108 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-3ff8202d-540d-4505-bcff-64d54df5e1f9 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:11.493418 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3ff8202d-540d-4505-bcff-64d54df5e1f9 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860" status: 200 len: 1521 microversion: 2.1 time: 0.155801 Jun 16 12:28:11.494046 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 108/223] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:11 2022] GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:28:12.511124 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-80017c76-78dc-47dc-a77b-efc501f78996 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:12.511853 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-80017c76-78dc-47dc-a77b-efc501f78996 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: 331b2de0-3963-4186-bc19-f2fe2e97d860] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:12.514464 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=68 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:28:12.520053 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-80017c76-78dc-47dc-a77b-efc501f78996 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:12.520584 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-80017c76-78dc-47dc-a77b-efc501f78996 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:12.521439 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-80017c76-78dc-47dc-a77b-efc501f78996 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:12.521976 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-80017c76-78dc-47dc-a77b-efc501f78996 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:12.671810 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-80017c76-78dc-47dc-a77b-efc501f78996 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:12.679641 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-80017c76-78dc-47dc-a77b-efc501f78996 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860" status: 200 len: 1521 microversion: 2.1 time: 0.172372 Jun 16 12:28:12.680210 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 116/224] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:12 2022] GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:28:13.696572 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3412cf21-9757-4c14-9a81-f3f071beb7bc tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:13.697377 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3412cf21-9757-4c14-9a81-f3f071beb7bc tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: 331b2de0-3963-4186-bc19-f2fe2e97d860] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:13.706468 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3412cf21-9757-4c14-9a81-f3f071beb7bc tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:13.708943 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3412cf21-9757-4c14-9a81-f3f071beb7bc tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:13.710750 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3412cf21-9757-4c14-9a81-f3f071beb7bc tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:13.714091 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3412cf21-9757-4c14-9a81-f3f071beb7bc tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:13.891368 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-3412cf21-9757-4c14-9a81-f3f071beb7bc tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:13.899710 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3412cf21-9757-4c14-9a81-f3f071beb7bc tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860" status: 200 len: 1521 microversion: 2.1 time: 0.207005 Jun 16 12:28:13.900281 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 109/225] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:13 2022] GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860 => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:28:14.917113 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-01d4aa6c-1e5e-4ba7-bb3d-e5df0a4ea7e8 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:14.917812 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-01d4aa6c-1e5e-4ba7-bb3d-e5df0a4ea7e8 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: 331b2de0-3963-4186-bc19-f2fe2e97d860] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:14.925709 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-01d4aa6c-1e5e-4ba7-bb3d-e5df0a4ea7e8 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:14.926478 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-01d4aa6c-1e5e-4ba7-bb3d-e5df0a4ea7e8 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:14.927467 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-01d4aa6c-1e5e-4ba7-bb3d-e5df0a4ea7e8 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:14.927976 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-01d4aa6c-1e5e-4ba7-bb3d-e5df0a4ea7e8 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:15.114138 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-01d4aa6c-1e5e-4ba7-bb3d-e5df0a4ea7e8 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:15.124600 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-01d4aa6c-1e5e-4ba7-bb3d-e5df0a4ea7e8 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860" status: 200 len: 1521 microversion: 2.1 time: 0.210938 Jun 16 12:28:15.126048 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 117/226] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:14 2022] GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860 => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:28:16.143686 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ce18a0d8-8fe7-405e-8480-761e631787ce tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:16.144302 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ce18a0d8-8fe7-405e-8480-761e631787ce tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: 331b2de0-3963-4186-bc19-f2fe2e97d860] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:16.151794 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ce18a0d8-8fe7-405e-8480-761e631787ce tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:16.152502 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ce18a0d8-8fe7-405e-8480-761e631787ce tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:16.153660 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ce18a0d8-8fe7-405e-8480-761e631787ce tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:16.155036 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ce18a0d8-8fe7-405e-8480-761e631787ce tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:16.345729 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ce18a0d8-8fe7-405e-8480-761e631787ce tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:16.355773 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ce18a0d8-8fe7-405e-8480-761e631787ce tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860" status: 200 len: 1521 microversion: 2.1 time: 0.217283 Jun 16 12:28:16.356604 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 110/227] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:16 2022] GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860 => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:28:17.373668 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a7b26bf8-f3d4-4a09-9967-036d0bc741cc tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:17.374285 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a7b26bf8-f3d4-4a09-9967-036d0bc741cc tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: 331b2de0-3963-4186-bc19-f2fe2e97d860] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:17.380188 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a7b26bf8-f3d4-4a09-9967-036d0bc741cc tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:17.380690 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a7b26bf8-f3d4-4a09-9967-036d0bc741cc tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:17.381394 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a7b26bf8-f3d4-4a09-9967-036d0bc741cc tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:17.382266 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a7b26bf8-f3d4-4a09-9967-036d0bc741cc tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:17.548154 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a7b26bf8-f3d4-4a09-9967-036d0bc741cc tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:17.559654 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a7b26bf8-f3d4-4a09-9967-036d0bc741cc tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860" status: 200 len: 1521 microversion: 2.1 time: 0.188965 Jun 16 12:28:17.561231 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 118/228] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:17 2022] GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860 => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:28:17.649189 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7151febc-206c-4204-95a3-23eb06836c5f tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:17.649850 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7151febc-206c-4204-95a3-23eb06836c5f tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] [instance: c72b39de-9695-4833-8a7a-76af4eaa33d4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:17.659521 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7151febc-206c-4204-95a3-23eb06836c5f tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:17.662004 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7151febc-206c-4204-95a3-23eb06836c5f tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:17.662803 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7151febc-206c-4204-95a3-23eb06836c5f tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:17.663246 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7151febc-206c-4204-95a3-23eb06836c5f tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:17.700272 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7151febc-206c-4204-95a3-23eb06836c5f tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] [instance: c72b39de-9695-4833-8a7a-76af4eaa33d4] Going to try to terminate instance {{(pid=117607) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 12:28:17.812092 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7151febc-206c-4204-95a3-23eb06836c5f tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] 10.222.0.45 "DELETE /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4" status: 204 len: 0 microversion: 2.1 time: 0.166889 Jun 16 12:28:17.812679 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 111/229] 10.222.0.45 () {58 vars in 1238 bytes} [Thu Jun 16 12:28:17 2022] DELETE /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 12:28:17.824274 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1b906d92-b32a-4ce2-a4ec-a56408a3c830 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:17.825167 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1b906d92-b32a-4ce2-a4ec-a56408a3c830 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] [instance: c72b39de-9695-4833-8a7a-76af4eaa33d4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:17.837796 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1b906d92-b32a-4ce2-a4ec-a56408a3c830 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:17.838271 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1b906d92-b32a-4ce2-a4ec-a56408a3c830 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:17.839031 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1b906d92-b32a-4ce2-a4ec-a56408a3c830 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:17.843230 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1b906d92-b32a-4ce2-a4ec-a56408a3c830 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:18.026980 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1b906d92-b32a-4ce2-a4ec-a56408a3c830 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf22beda54e24b878e514304e7a62b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66000602298490b9e76d8138fdb825b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:18.036886 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1b906d92-b32a-4ce2-a4ec-a56408a3c830 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] 10.222.0.45 "GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4" status: 200 len: 1553 microversion: 2.1 time: 0.219434 Jun 16 12:28:18.037462 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 119/230] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:17 2022] GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4 => generated 1553 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:28:18.580428 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6d7ffe75-a987-4d7c-a293-e1667562122d tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:18.581130 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6d7ffe75-a987-4d7c-a293-e1667562122d tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: 331b2de0-3963-4186-bc19-f2fe2e97d860] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:18.587102 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6d7ffe75-a987-4d7c-a293-e1667562122d tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:18.587554 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6d7ffe75-a987-4d7c-a293-e1667562122d tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:18.588405 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6d7ffe75-a987-4d7c-a293-e1667562122d tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:18.588843 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6d7ffe75-a987-4d7c-a293-e1667562122d tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:18.756349 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6d7ffe75-a987-4d7c-a293-e1667562122d tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:18.769711 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6d7ffe75-a987-4d7c-a293-e1667562122d tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860" status: 200 len: 1521 microversion: 2.1 time: 0.190084 Jun 16 12:28:18.770378 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 112/231] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:18 2022] GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860 => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:28:19.054511 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e4eeb615-7fa2-4e64-86f1-b99cab0c55ff tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:19.055124 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e4eeb615-7fa2-4e64-86f1-b99cab0c55ff tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] [instance: c72b39de-9695-4833-8a7a-76af4eaa33d4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:19.065093 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e4eeb615-7fa2-4e64-86f1-b99cab0c55ff tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:19.066789 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e4eeb615-7fa2-4e64-86f1-b99cab0c55ff tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:19.068675 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e4eeb615-7fa2-4e64-86f1-b99cab0c55ff tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:19.070527 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e4eeb615-7fa2-4e64-86f1-b99cab0c55ff tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:19.292699 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e4eeb615-7fa2-4e64-86f1-b99cab0c55ff tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf22beda54e24b878e514304e7a62b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66000602298490b9e76d8138fdb825b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:19.304542 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e4eeb615-7fa2-4e64-86f1-b99cab0c55ff tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] 10.222.0.45 "GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4" status: 200 len: 1553 microversion: 2.1 time: 0.254139 Jun 16 12:28:19.316501 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 120/232] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:19 2022] GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4 => generated 1553 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:28:19.787579 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3aa9e84b-1930-4088-bd93-9e21d3a63254 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:19.788165 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3aa9e84b-1930-4088-bd93-9e21d3a63254 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: 331b2de0-3963-4186-bc19-f2fe2e97d860] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:19.795438 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3aa9e84b-1930-4088-bd93-9e21d3a63254 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:19.795873 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3aa9e84b-1930-4088-bd93-9e21d3a63254 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:19.796646 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3aa9e84b-1930-4088-bd93-9e21d3a63254 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:19.797082 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3aa9e84b-1930-4088-bd93-9e21d3a63254 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:19.935302 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-3aa9e84b-1930-4088-bd93-9e21d3a63254 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:19.943172 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3aa9e84b-1930-4088-bd93-9e21d3a63254 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860" status: 200 len: 1521 microversion: 2.1 time: 0.159987 Jun 16 12:28:19.943744 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 113/233] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:19 2022] GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:28:20.195854 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-69c33bc8-04c2-4f7b-a61e-9df701f42952 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1287614543", "imageRef": "c736a2d2-9d0d-41ec-b9fc-971428b0ff7a", "flavorRef": "452"}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:28:20.250313 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.network.neutron [None req-69c33bc8-04c2-4f7b-a61e-9df701f42952 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] validate_networks() for None {{(pid=117606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 12:28:20.322385 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-68bba0f4-5c57-4ef0-90e5-a72b03338502 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:20.323089 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-68bba0f4-5c57-4ef0-90e5-a72b03338502 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] [instance: c72b39de-9695-4833-8a7a-76af4eaa33d4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:20.329994 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-68bba0f4-5c57-4ef0-90e5-a72b03338502 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:20.330571 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-68bba0f4-5c57-4ef0-90e5-a72b03338502 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:20.331614 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-68bba0f4-5c57-4ef0-90e5-a72b03338502 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:20.332104 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-68bba0f4-5c57-4ef0-90e5-a72b03338502 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:20.349230 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:28:20.689345 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-68bba0f4-5c57-4ef0-90e5-a72b03338502 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf22beda54e24b878e514304e7a62b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66000602298490b9e76d8138fdb825b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:20.701845 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-68bba0f4-5c57-4ef0-90e5-a72b03338502 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] 10.222.0.45 "GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4" status: 200 len: 1553 microversion: 2.1 time: 0.382883 Jun 16 12:28:20.711738 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 114/234] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:20 2022] GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4 => generated 1553 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:28:20.739556 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-69c33bc8-04c2-4f7b-a61e-9df701f42952 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Flavor limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 12:28:20.739993 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-69c33bc8-04c2-4f7b-a61e-9df701f42952 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Image limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 12:28:20.740471 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-69c33bc8-04c2-4f7b-a61e-9df701f42952 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Flavor pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 12:28:20.741069 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-69c33bc8-04c2-4f7b-a61e-9df701f42952 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Image pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 12:28:20.741492 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-69c33bc8-04c2-4f7b-a61e-9df701f42952 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 12:28:20.752632 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-69c33bc8-04c2-4f7b-a61e-9df701f42952 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:20.753086 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-69c33bc8-04c2-4f7b-a61e-9df701f42952 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:20.753899 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-69c33bc8-04c2-4f7b-a61e-9df701f42952 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:20.754357 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-69c33bc8-04c2-4f7b-a61e-9df701f42952 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:20.772199 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-69c33bc8-04c2-4f7b-a61e-9df701f42952 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Getting quotas for project 6311ff745dcd4bddaba0a78f4597cd0c. Resources: {'instances', 'cores', 'ram'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 12:28:20.776697 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-69c33bc8-04c2-4f7b-a61e-9df701f42952 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Getting quotas for user 3c3afeab761e46569123b3a12158dcea and project 6311ff745dcd4bddaba0a78f4597cd0c. Resources: {'instances', 'cores', 'ram'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 12:28:20.788776 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-69c33bc8-04c2-4f7b-a61e-9df701f42952 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Going to run 1 instances... {{(pid=117606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 12:28:20.791122 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-69c33bc8-04c2-4f7b-a61e-9df701f42952 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] [instance: 2ebaa78e-5a30-4e1c-b96d-378dd8effe75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c736a2d2-9d0d-41ec-b9fc-971428b0ff7a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 12:28:20.837446 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-69c33bc8-04c2-4f7b-a61e-9df701f42952 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.645579 Jun 16 12:28:20.842017 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 121/235] 10.222.0.45 () {60 vars in 1146 bytes} [Thu Jun 16 12:28:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 12:28:20.847838 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d6ebfd37-ffbb-40b8-b095-58392664a8f5 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:20.848446 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d6ebfd37-ffbb-40b8-b095-58392664a8f5 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] [instance: 2ebaa78e-5a30-4e1c-b96d-378dd8effe75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:20.906473 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d6ebfd37-ffbb-40b8-b095-58392664a8f5 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c3afeab761e46569123b3a12158dcea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311ff745dcd4bddaba0a78f4597cd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:20.913330 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d6ebfd37-ffbb-40b8-b095-58392664a8f5 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] 10.222.0.45 "GET /compute/v2.1/servers/2ebaa78e-5a30-4e1c-b96d-378dd8effe75" status: 200 len: 1215 microversion: 2.1 time: 0.069114 Jun 16 12:28:20.913948 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 115/236] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:20 2022] GET /compute/v2.1/servers/2ebaa78e-5a30-4e1c-b96d-378dd8effe75 => generated 1215 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:28:20.962864 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-90544966-96b9-4afc-8d36-12a12771ec8e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:20.962864 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-90544966-96b9-4afc-8d36-12a12771ec8e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: 331b2de0-3963-4186-bc19-f2fe2e97d860] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:20.969519 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-90544966-96b9-4afc-8d36-12a12771ec8e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:20.970150 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-90544966-96b9-4afc-8d36-12a12771ec8e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:20.971080 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-90544966-96b9-4afc-8d36-12a12771ec8e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:20.971662 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-90544966-96b9-4afc-8d36-12a12771ec8e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:20.992597 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:28:21.122926 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-90544966-96b9-4afc-8d36-12a12771ec8e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:21.132024 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-90544966-96b9-4afc-8d36-12a12771ec8e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860" status: 200 len: 1521 microversion: 2.1 time: 0.174897 Jun 16 12:28:21.143556 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 122/237] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:20 2022] GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:28:21.719307 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-76570ac9-9bd2-4d08-874c-54522b309ba5 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:21.720184 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-76570ac9-9bd2-4d08-874c-54522b309ba5 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] [instance: c72b39de-9695-4833-8a7a-76af4eaa33d4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:21.726388 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-76570ac9-9bd2-4d08-874c-54522b309ba5 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:21.726968 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-76570ac9-9bd2-4d08-874c-54522b309ba5 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:21.727849 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-76570ac9-9bd2-4d08-874c-54522b309ba5 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:21.728386 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-76570ac9-9bd2-4d08-874c-54522b309ba5 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:21.934562 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-62c1a791-e836-4328-93a3-ebee9a97a68c tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:21.936252 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-62c1a791-e836-4328-93a3-ebee9a97a68c tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] [instance: 2ebaa78e-5a30-4e1c-b96d-378dd8effe75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:21.954229 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-62c1a791-e836-4328-93a3-ebee9a97a68c tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:21.956859 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-62c1a791-e836-4328-93a3-ebee9a97a68c tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:21.959091 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-62c1a791-e836-4328-93a3-ebee9a97a68c tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:21.963500 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-62c1a791-e836-4328-93a3-ebee9a97a68c tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:22.066407 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-62c1a791-e836-4328-93a3-ebee9a97a68c tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c3afeab761e46569123b3a12158dcea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311ff745dcd4bddaba0a78f4597cd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:22.076121 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-62c1a791-e836-4328-93a3-ebee9a97a68c tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] 10.222.0.45 "GET /compute/v2.1/servers/2ebaa78e-5a30-4e1c-b96d-378dd8effe75" status: 200 len: 1219 microversion: 2.1 time: 0.145357 Jun 16 12:28:22.077176 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 123/238] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:21 2022] GET /compute/v2.1/servers/2ebaa78e-5a30-4e1c-b96d-378dd8effe75 => generated 1219 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:28:22.096004 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-76570ac9-9bd2-4d08-874c-54522b309ba5 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf22beda54e24b878e514304e7a62b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66000602298490b9e76d8138fdb825b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:22.104864 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-76570ac9-9bd2-4d08-874c-54522b309ba5 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] 10.222.0.45 "GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4" status: 200 len: 1553 microversion: 2.1 time: 0.389479 Jun 16 12:28:22.105410 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 116/239] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:21 2022] GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4 => generated 1553 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:28:22.150887 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-360ce2f4-2c71-4175-b97f-6d11efaf83d2 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:22.151756 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-360ce2f4-2c71-4175-b97f-6d11efaf83d2 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: 331b2de0-3963-4186-bc19-f2fe2e97d860] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:22.159954 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-360ce2f4-2c71-4175-b97f-6d11efaf83d2 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:22.160940 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-360ce2f4-2c71-4175-b97f-6d11efaf83d2 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:22.162245 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-360ce2f4-2c71-4175-b97f-6d11efaf83d2 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:22.162886 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-360ce2f4-2c71-4175-b97f-6d11efaf83d2 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:22.346828 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-360ce2f4-2c71-4175-b97f-6d11efaf83d2 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:22.355570 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-360ce2f4-2c71-4175-b97f-6d11efaf83d2 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860" status: 200 len: 1521 microversion: 2.1 time: 0.208548 Jun 16 12:28:22.364020 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 124/240] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:22 2022] GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860 => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:28:23.095904 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-797b0909-d007-4efc-b327-b3782af1be09 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:23.096723 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-797b0909-d007-4efc-b327-b3782af1be09 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] [instance: 2ebaa78e-5a30-4e1c-b96d-378dd8effe75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:23.110778 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-797b0909-d007-4efc-b327-b3782af1be09 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:23.113393 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-797b0909-d007-4efc-b327-b3782af1be09 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:23.114602 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-797b0909-d007-4efc-b327-b3782af1be09 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:23.118528 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-797b0909-d007-4efc-b327-b3782af1be09 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:23.123722 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-166b6c48-c34a-42fa-b4c5-86bf3f221985 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:23.125314 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-166b6c48-c34a-42fa-b4c5-86bf3f221985 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] [instance: c72b39de-9695-4833-8a7a-76af4eaa33d4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:23.140111 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-166b6c48-c34a-42fa-b4c5-86bf3f221985 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:23.140568 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-166b6c48-c34a-42fa-b4c5-86bf3f221985 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:23.141352 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-166b6c48-c34a-42fa-b4c5-86bf3f221985 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:23.141787 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-166b6c48-c34a-42fa-b4c5-86bf3f221985 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:23.498820 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-797b0909-d007-4efc-b327-b3782af1be09 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c3afeab761e46569123b3a12158dcea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311ff745dcd4bddaba0a78f4597cd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:23.523118 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-797b0909-d007-4efc-b327-b3782af1be09 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] 10.222.0.45 "GET /compute/v2.1/servers/2ebaa78e-5a30-4e1c-b96d-378dd8effe75" status: 200 len: 1267 microversion: 2.1 time: 0.429993 Jun 16 12:28:23.538030 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 117/241] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:23 2022] GET /compute/v2.1/servers/2ebaa78e-5a30-4e1c-b96d-378dd8effe75 => generated 1267 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:28:23.546871 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-04eba554-f71b-46d8-a720-0595e79fb37e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:23.547729 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-04eba554-f71b-46d8-a720-0595e79fb37e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: 331b2de0-3963-4186-bc19-f2fe2e97d860] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:23.566248 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-04eba554-f71b-46d8-a720-0595e79fb37e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:23.567190 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-04eba554-f71b-46d8-a720-0595e79fb37e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:23.568464 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-04eba554-f71b-46d8-a720-0595e79fb37e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:23.569120 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-04eba554-f71b-46d8-a720-0595e79fb37e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:23.717618 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-166b6c48-c34a-42fa-b4c5-86bf3f221985 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf22beda54e24b878e514304e7a62b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66000602298490b9e76d8138fdb825b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:23.727220 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-166b6c48-c34a-42fa-b4c5-86bf3f221985 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] 10.222.0.45 "GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4" status: 200 len: 1553 microversion: 2.1 time: 0.607882 Jun 16 12:28:23.728063 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 125/242] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:23 2022] GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4 => generated 1553 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:28:23.932788 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-04eba554-f71b-46d8-a720-0595e79fb37e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:23.941527 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-04eba554-f71b-46d8-a720-0595e79fb37e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860" status: 200 len: 1501 microversion: 2.1 time: 0.401174 Jun 16 12:28:23.952688 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 118/243] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:23 2022] GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860 => generated 1501 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:28:23.957448 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-89c73e2d-759f-4830-a5be-6c7d98863d91 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:23.961892 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-89c73e2d-759f-4830-a5be-6c7d98863d91 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c7405152-1807-4b2a-8701-ef2b2a8cbafb] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:23.974353 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-89c73e2d-759f-4830-a5be-6c7d98863d91 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:23.979866 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-89c73e2d-759f-4830-a5be-6c7d98863d91 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:23.980686 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-89c73e2d-759f-4830-a5be-6c7d98863d91 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:23.981129 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-89c73e2d-759f-4830-a5be-6c7d98863d91 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:24.050288 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-9e88df1c-459e-4ace-8554-b487305ffaf0 req-09745eef-4bdf-4d2c-8615-fb135f58cd3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c72b39de-9695-4833-8a7a-76af4eaa33d4", "name": "network-vif-deleted", "tag": "c043bee4-c23f-4c99-b00d-fb8989bd7376"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:28:24.067262 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-9e88df1c-459e-4ace-8554-b487305ffaf0 req-09745eef-4bdf-4d2c-8615-fb135f58cd3a service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:24.068104 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-9e88df1c-459e-4ace-8554-b487305ffaf0 req-09745eef-4bdf-4d2c-8615-fb135f58cd3a service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:24.080843 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-9e88df1c-459e-4ace-8554-b487305ffaf0 req-09745eef-4bdf-4d2c-8615-fb135f58cd3a service nova] Creating event network-vif-deleted:c043bee4-c23f-4c99-b00d-fb8989bd7376 for instance c72b39de-9695-4833-8a7a-76af4eaa33d4 on hv-cinder-84614 Jun 16 12:28:24.087307 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-9e88df1c-459e-4ace-8554-b487305ffaf0 req-09745eef-4bdf-4d2c-8615-fb135f58cd3a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044092 Jun 16 12:28:24.088686 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 119/244] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:28:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 12:28:24.241262 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-89c73e2d-759f-4830-a5be-6c7d98863d91 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:24.249808 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-89c73e2d-759f-4830-a5be-6c7d98863d91 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb" status: 200 len: 1515 microversion: 2.1 time: 0.296030 Jun 16 12:28:24.259343 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 126/245] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:23 2022] GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb => generated 1515 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:28:24.544918 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-03e923e4-353d-47ad-8d02-e83d31f8b354 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:24.546401 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-03e923e4-353d-47ad-8d02-e83d31f8b354 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] [instance: 2ebaa78e-5a30-4e1c-b96d-378dd8effe75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:24.558092 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-03e923e4-353d-47ad-8d02-e83d31f8b354 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:24.559639 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-03e923e4-353d-47ad-8d02-e83d31f8b354 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:24.560859 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-03e923e4-353d-47ad-8d02-e83d31f8b354 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:24.561448 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-03e923e4-353d-47ad-8d02-e83d31f8b354 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:24.731075 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-03e923e4-353d-47ad-8d02-e83d31f8b354 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c3afeab761e46569123b3a12158dcea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311ff745dcd4bddaba0a78f4597cd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:24.744088 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c878e396-3a8d-4737-83df-4c55dc856348 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:24.745030 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c878e396-3a8d-4737-83df-4c55dc856348 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] [instance: c72b39de-9695-4833-8a7a-76af4eaa33d4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:24.755908 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c878e396-3a8d-4737-83df-4c55dc856348 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:24.756369 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c878e396-3a8d-4737-83df-4c55dc856348 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:24.759144 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-03e923e4-353d-47ad-8d02-e83d31f8b354 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] 10.222.0.45 "GET /compute/v2.1/servers/2ebaa78e-5a30-4e1c-b96d-378dd8effe75" status: 200 len: 1273 microversion: 2.1 time: 0.220427 Jun 16 12:28:24.769237 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 120/246] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:24 2022] GET /compute/v2.1/servers/2ebaa78e-5a30-4e1c-b96d-378dd8effe75 => generated 1273 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:28:24.769419 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c878e396-3a8d-4737-83df-4c55dc856348 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:24.769419 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c878e396-3a8d-4737-83df-4c55dc856348 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:24.812373 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c878e396-3a8d-4737-83df-4c55dc856348 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:24.813032 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c878e396-3a8d-4737-83df-4c55dc856348 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:24.813653 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.objects.instance [None req-c878e396-3a8d-4737-83df-4c55dc856348 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lazy-loading 'fault' on Instance uuid c72b39de-9695-4833-8a7a-76af4eaa33d4 {{(pid=117606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 12:28:24.973805 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c878e396-3a8d-4737-83df-4c55dc856348 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf22beda54e24b878e514304e7a62b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66000602298490b9e76d8138fdb825b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:24.986902 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c878e396-3a8d-4737-83df-4c55dc856348 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] 10.222.0.45 "GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4" status: 200 len: 1351 microversion: 2.1 time: 0.247275 Jun 16 12:28:24.990195 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 127/247] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:24 2022] GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4 => generated 1351 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:28:25.783812 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0663df3d-4872-46a4-811c-a87c8abfdcf5 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:25.784419 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0663df3d-4872-46a4-811c-a87c8abfdcf5 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] [instance: 2ebaa78e-5a30-4e1c-b96d-378dd8effe75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:25.791897 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-96087578-b38c-4df3-a631-92da0d801ccf tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:28:25.797679 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-96087578-b38c-4df3-a631-92da0d801ccf tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c7405152-1807-4b2a-8701-ef2b2a8cbafb] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:25.807929 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0663df3d-4872-46a4-811c-a87c8abfdcf5 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:25.810153 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-96087578-b38c-4df3-a631-92da0d801ccf tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:25.810869 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0663df3d-4872-46a4-811c-a87c8abfdcf5 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:25.811522 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-96087578-b38c-4df3-a631-92da0d801ccf tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:25.812511 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0663df3d-4872-46a4-811c-a87c8abfdcf5 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:25.813484 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-96087578-b38c-4df3-a631-92da0d801ccf tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:25.814146 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0663df3d-4872-46a4-811c-a87c8abfdcf5 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:25.814781 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-96087578-b38c-4df3-a631-92da0d801ccf tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:25.867941 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.objects.instance [None req-96087578-b38c-4df3-a631-92da0d801ccf tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lazy-loading 'flavor' on Instance uuid c7405152-1807-4b2a-8701-ef2b2a8cbafb {{(pid=117606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 12:28:26.093802 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-96087578-b38c-4df3-a631-92da0d801ccf tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "POST /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb/action" status: 200 len: 32 microversion: 2.1 time: 0.306711 Jun 16 12:28:26.110588 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 128/248] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Jun 16 12:28:25 2022] POST /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb/action => generated 32 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 12:28:26.140221 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-42e625de-6260-462f-b9a2-e494cd680b26 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:26.141841 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-42e625de-6260-462f-b9a2-e494cd680b26 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] [instance: c72b39de-9695-4833-8a7a-76af4eaa33d4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:26.163363 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-42e625de-6260-462f-b9a2-e494cd680b26 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:26.164164 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-42e625de-6260-462f-b9a2-e494cd680b26 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:26.165097 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-42e625de-6260-462f-b9a2-e494cd680b26 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:26.165678 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-42e625de-6260-462f-b9a2-e494cd680b26 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:26.199565 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-42e625de-6260-462f-b9a2-e494cd680b26 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] HTTP exception thrown: Instance c72b39de-9695-4833-8a7a-76af4eaa33d4 could not be found. Jun 16 12:28:26.239340 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-42e625de-6260-462f-b9a2-e494cd680b26 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Request method failure captured: Jun 16 12:28:26.239340 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: request: GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4 HTTP/1.1 Jun 16 12:28:26.239340 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 16 12:28:26.239340 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 16 12:28:26.239340 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Connection: close Jun 16 12:28:26.239340 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 16 12:28:26.239340 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 16 12:28:26.239340 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Host: 10.222.0.45 Jun 16 12:28:26.239340 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 16 12:28:26.239340 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 16 12:28:26.239340 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABiqyGH9mtQokQpQY6BjOxsC157_dv-gpOooiVVS5n5B_gMr0vBLjFLWXmczXrb9PSWjcH8SMzwdYYoylcgAE1ViZyEX8CGUnApXZVpoBgqUH11AYg8GtCnO6esZHrvX0FVGZgFy3hPhdE_WGgIkyxkORteR0fkMddlXr49tymIcP85G4M Jun 16 12:28:26.239340 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 16 12:28:26.239340 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 16 12:28:26.239340 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 16 12:28:26.239340 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 16 12:28:26.239340 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 16 12:28:26.239340 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 16 12:28:26.239340 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Id: a66000602298490b9e76d8138fdb825b Jun 16 12:28:26.239340 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-DeleteServersTestJSON-41721904 Jun 16 12:28:26.239340 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 16 12:28:26.239340 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 16 12:28:26.240638 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a66000602298490b9e76d8138fdb825b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a66000602298490b9e76d8138fdb825b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a66000602298490b9e76d8138fdb825b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a66000602298490b9e76d8138fdb825b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Jun 16 12:28:26.240638 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-DeleteServersTestJSON-41721904 Jun 16 12:28:26.240638 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant-Id: a66000602298490b9e76d8138fdb825b Jun 16 12:28:26.240638 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-DeleteServersTestJSON-41721904 Jun 16 12:28:26.240638 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User: tempest-DeleteServersTestJSON-41721904-project Jun 16 12:28:26.240638 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 16 12:28:26.240638 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 16 12:28:26.240638 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Id: cf22beda54e24b878e514304e7a62b65 Jun 16 12:28:26.240638 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-DeleteServersTestJSON-41721904-project Jun 16 12:28:26.240638 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: method: > Jun 16 12:28:26.240638 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: exception: Instance c72b39de-9695-4833-8a7a-76af4eaa33d4 could not be found. Jun 16 12:28:26.240638 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: action_args: {'id': 'c72b39de-9695-4833-8a7a-76af4eaa33d4'} Jun 16 12:28:26.241319 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:28:26.241319 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:28:26.241319 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:28:26.241319 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:28:26.241319 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:28:26.241319 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:28:26.241319 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:28:26.241319 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:28:26.241319 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:28:26.241319 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:28:26.241319 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c72b39de-9695-4833-8a7a-76af4eaa33d4 could not be found. Jun 16 12:28:26.241319 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:28:26.241319 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:28:26.241319 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:28:26.241319 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:28:26.241319 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:28:26.241319 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:28:26.241319 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:28:26.241319 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:28:26.241319 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:28:26.243049 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:28:26.243049 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 12:28:26.243049 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 12:28:26.243049 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:28:26.243049 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:28:26.243049 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:28:26.243049 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:28:26.243049 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c72b39de-9695-4833-8a7a-76af4eaa33d4 could not be found. Jun 16 12:28:26.243049 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:28:26.243049 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:28:26.243049 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:28:26.243049 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:28:26.243049 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:28:26.243049 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:28:26.243049 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:28:26.243049 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:28:26.243049 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c72b39de-9695-4833-8a7a-76af4eaa33d4 could not be found. Jun 16 12:28:26.243049 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:28:26.252066 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-42e625de-6260-462f-b9a2-e494cd680b26 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Returning 404 to user: Instance c72b39de-9695-4833-8a7a-76af4eaa33d4 could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:28:26.253219 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-42e625de-6260-462f-b9a2-e494cd680b26 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] 10.222.0.45 "GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4" status: 404 len: 111 microversion: 2.1 time: 0.131431 Jun 16 12:28:26.257326 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 129/249] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:26 2022] GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 12:28:26.266427 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-6dc2ec60-35d9-4968-bd70-bf6beb459fce req-9fef390c-3304-4212-8527-72b00ddf1e08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ebaa78e-5a30-4e1c-b96d-378dd8effe75", "tag": "11e2a024-84a4-4729-b062-5e10d0658fed"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:28:26.293594 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-6dc2ec60-35d9-4968-bd70-bf6beb459fce req-9fef390c-3304-4212-8527-72b00ddf1e08 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:26.294608 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-6dc2ec60-35d9-4968-bd70-bf6beb459fce req-9fef390c-3304-4212-8527-72b00ddf1e08 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:26.320384 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-6dc2ec60-35d9-4968-bd70-bf6beb459fce req-9fef390c-3304-4212-8527-72b00ddf1e08 service nova] Creating event network-changed:11e2a024-84a4-4729-b062-5e10d0658fed for instance 2ebaa78e-5a30-4e1c-b96d-378dd8effe75 on hv-cinder-84614 Jun 16 12:28:26.333416 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-6dc2ec60-35d9-4968-bd70-bf6beb459fce req-9fef390c-3304-4212-8527-72b00ddf1e08 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074461 Jun 16 12:28:26.335078 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 130/250] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:28:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:28:26.351606 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-de169707-0350-4460-ab9f-255c47fb2128 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:26.353449 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-de169707-0350-4460-ab9f-255c47fb2128 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c7405152-1807-4b2a-8701-ef2b2a8cbafb] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:26.370675 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-de169707-0350-4460-ab9f-255c47fb2128 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:26.371128 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-de169707-0350-4460-ab9f-255c47fb2128 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:26.371905 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-de169707-0350-4460-ab9f-255c47fb2128 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:26.372392 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-de169707-0350-4460-ab9f-255c47fb2128 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:26.577437 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0663df3d-4872-46a4-811c-a87c8abfdcf5 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c3afeab761e46569123b3a12158dcea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311ff745dcd4bddaba0a78f4597cd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:26.588837 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0663df3d-4872-46a4-811c-a87c8abfdcf5 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] 10.222.0.45 "GET /compute/v2.1/servers/2ebaa78e-5a30-4e1c-b96d-378dd8effe75" status: 200 len: 1315 microversion: 2.1 time: 0.808671 Jun 16 12:28:26.599119 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 121/251] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:25 2022] GET /compute/v2.1/servers/2ebaa78e-5a30-4e1c-b96d-378dd8effe75 => generated 1315 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:28:26.604906 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-981a79cf-c414-47fa-9e74-07b913350cdf tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:26.606272 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-981a79cf-c414-47fa-9e74-07b913350cdf tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] [instance: c72b39de-9695-4833-8a7a-76af4eaa33d4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:26.628246 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-981a79cf-c414-47fa-9e74-07b913350cdf tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:26.628876 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-981a79cf-c414-47fa-9e74-07b913350cdf tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:26.629927 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-981a79cf-c414-47fa-9e74-07b913350cdf tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:26.630658 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-981a79cf-c414-47fa-9e74-07b913350cdf tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:26.662905 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-981a79cf-c414-47fa-9e74-07b913350cdf tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] HTTP exception thrown: Instance c72b39de-9695-4833-8a7a-76af4eaa33d4 could not be found. Jun 16 12:28:26.679569 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-981a79cf-c414-47fa-9e74-07b913350cdf tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Request method failure captured: Jun 16 12:28:26.679569 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: request: GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4/os-volume_attachments HTTP/1.1 Jun 16 12:28:26.679569 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Accept: application/json Jun 16 12:28:26.679569 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jun 16 12:28:26.679569 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Connection: close Jun 16 12:28:26.679569 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jun 16 12:28:26.679569 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jun 16 12:28:26.679569 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Host: 10.222.0.45 Jun 16 12:28:26.679569 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jun 16 12:28:26.679569 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jun 16 12:28:26.679569 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABiqyGH9mtQokQpQY6BjOxsC157_dv-gpOooiVVS5n5B_gMr0vBLjFLWXmczXrb9PSWjcH8SMzwdYYoylcgAE1ViZyEX8CGUnApXZVpoBgqUH11AYg8GtCnO6esZHrvX0FVGZgFy3hPhdE_WGgIkyxkORteR0fkMddlXr49tymIcP85G4M Jun 16 12:28:26.679569 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jun 16 12:28:26.679569 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jun 16 12:28:26.679569 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jun 16 12:28:26.679569 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jun 16 12:28:26.679569 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jun 16 12:28:26.679569 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jun 16 12:28:26.679569 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Id: a66000602298490b9e76d8138fdb825b Jun 16 12:28:26.679569 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-DeleteServersTestJSON-41721904 Jun 16 12:28:26.679569 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Role: member,reader Jun 16 12:28:26.679569 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Roles: member,reader Jun 16 12:28:26.680824 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a66000602298490b9e76d8138fdb825b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a66000602298490b9e76d8138fdb825b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a66000602298490b9e76d8138fdb825b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a66000602298490b9e76d8138fdb825b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Jun 16 12:28:26.680824 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-DeleteServersTestJSON-41721904 Jun 16 12:28:26.680824 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant-Id: a66000602298490b9e76d8138fdb825b Jun 16 12:28:26.680824 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-DeleteServersTestJSON-41721904 Jun 16 12:28:26.680824 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User: tempest-DeleteServersTestJSON-41721904-project Jun 16 12:28:26.680824 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jun 16 12:28:26.680824 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jun 16 12:28:26.680824 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Id: cf22beda54e24b878e514304e7a62b65 Jun 16 12:28:26.680824 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-DeleteServersTestJSON-41721904-project Jun 16 12:28:26.680824 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: method: > Jun 16 12:28:26.680824 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: exception: Instance c72b39de-9695-4833-8a7a-76af4eaa33d4 could not be found. Jun 16 12:28:26.680824 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: action_args: {'server_id': 'c72b39de-9695-4833-8a7a-76af4eaa33d4'} Jun 16 12:28:26.681490 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:28:26.681490 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:28:26.681490 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:28:26.681490 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:28:26.681490 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:28:26.681490 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:28:26.681490 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:28:26.681490 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:28:26.681490 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:28:26.681490 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:28:26.681490 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c72b39de-9695-4833-8a7a-76af4eaa33d4 could not be found. Jun 16 12:28:26.681490 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:28:26.681490 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:28:26.681490 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:28:26.681490 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:28:26.681490 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:28:26.681490 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:28:26.681490 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:28:26.681490 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:28:26.681490 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:28:26.682605 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:28:26.682605 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 16 12:28:26.682605 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 12:28:26.682605 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 16 12:28:26.682605 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 12:28:26.682605 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 16 12:28:26.682605 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 16 12:28:26.682605 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:28:26.682605 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:28:26.682605 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c72b39de-9695-4833-8a7a-76af4eaa33d4 could not be found. Jun 16 12:28:26.682605 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:28:26.682605 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:28:26.682605 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:28:26.682605 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:28:26.682605 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:28:26.682605 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:28:26.682605 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:28:26.682605 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:28:26.682605 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c72b39de-9695-4833-8a7a-76af4eaa33d4 could not be found. Jun 16 12:28:26.682605 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:28:26.688103 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-981a79cf-c414-47fa-9e74-07b913350cdf tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Returning 404 to user: Instance c72b39de-9695-4833-8a7a-76af4eaa33d4 could not be found. {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:28:26.688990 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-981a79cf-c414-47fa-9e74-07b913350cdf tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] 10.222.0.45 "GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.088528 Jun 16 12:28:26.689564 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 122/252] 10.222.0.45 () {58 vars in 1301 bytes} [Thu Jun 16 12:28:26 2022] GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4/os-volume_attachments => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 12:28:26.875385 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-de169707-0350-4460-ab9f-255c47fb2128 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:26.892245 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-de169707-0350-4460-ab9f-255c47fb2128 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb" status: 200 len: 1521 microversion: 2.1 time: 0.555756 Jun 16 12:28:26.892848 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 131/253] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:26 2022] GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb => generated 1521 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:28:27.615624 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-03a55038-eceb-4b90-8701-6be292b2e584 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:27.616239 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-03a55038-eceb-4b90-8701-6be292b2e584 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] [instance: 2ebaa78e-5a30-4e1c-b96d-378dd8effe75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:27.628342 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-03a55038-eceb-4b90-8701-6be292b2e584 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:27.631544 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-03a55038-eceb-4b90-8701-6be292b2e584 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:27.632367 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-03a55038-eceb-4b90-8701-6be292b2e584 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:27.632807 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-03a55038-eceb-4b90-8701-6be292b2e584 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:27.839264 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-03a55038-eceb-4b90-8701-6be292b2e584 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c3afeab761e46569123b3a12158dcea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311ff745dcd4bddaba0a78f4597cd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:27.847868 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-03a55038-eceb-4b90-8701-6be292b2e584 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] 10.222.0.45 "GET /compute/v2.1/servers/2ebaa78e-5a30-4e1c-b96d-378dd8effe75" status: 200 len: 1315 microversion: 2.1 time: 0.237151 Jun 16 12:28:27.848489 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 123/254] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:27 2022] GET /compute/v2.1/servers/2ebaa78e-5a30-4e1c-b96d-378dd8effe75 => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:28:27.909686 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-69ab2886-c599-4942-bef6-6c3d25f64669 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:27.910572 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-69ab2886-c599-4942-bef6-6c3d25f64669 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c7405152-1807-4b2a-8701-ef2b2a8cbafb] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:27.916733 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-69ab2886-c599-4942-bef6-6c3d25f64669 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:27.917185 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-69ab2886-c599-4942-bef6-6c3d25f64669 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:27.924272 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-69ab2886-c599-4942-bef6-6c3d25f64669 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:27.924946 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-69ab2886-c599-4942-bef6-6c3d25f64669 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:28.283761 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-69ab2886-c599-4942-bef6-6c3d25f64669 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:28.292329 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-69ab2886-c599-4942-bef6-6c3d25f64669 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb" status: 200 len: 1521 microversion: 2.1 time: 0.386809 Jun 16 12:28:28.302420 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 132/255] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:27 2022] GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb => generated 1521 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:28:28.865165 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f9d5b433-4614-4ae1-90dc-8603d280f104 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:28.865782 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f9d5b433-4614-4ae1-90dc-8603d280f104 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] [instance: 2ebaa78e-5a30-4e1c-b96d-378dd8effe75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:28.873349 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f9d5b433-4614-4ae1-90dc-8603d280f104 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:28.874187 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f9d5b433-4614-4ae1-90dc-8603d280f104 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:28.875217 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f9d5b433-4614-4ae1-90dc-8603d280f104 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:28.875869 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f9d5b433-4614-4ae1-90dc-8603d280f104 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:29.087339 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f9d5b433-4614-4ae1-90dc-8603d280f104 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c3afeab761e46569123b3a12158dcea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311ff745dcd4bddaba0a78f4597cd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:29.096835 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f9d5b433-4614-4ae1-90dc-8603d280f104 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] 10.222.0.45 "GET /compute/v2.1/servers/2ebaa78e-5a30-4e1c-b96d-378dd8effe75" status: 200 len: 1315 microversion: 2.1 time: 0.235687 Jun 16 12:28:29.097296 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 124/256] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:28 2022] GET /compute/v2.1/servers/2ebaa78e-5a30-4e1c-b96d-378dd8effe75 => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:28:29.312411 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-60b055b9-3cf4-4bde-b410-e4a3c635a628 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:29.313027 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-60b055b9-3cf4-4bde-b410-e4a3c635a628 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c7405152-1807-4b2a-8701-ef2b2a8cbafb] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:29.319119 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-60b055b9-3cf4-4bde-b410-e4a3c635a628 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:29.319775 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-60b055b9-3cf4-4bde-b410-e4a3c635a628 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:29.320728 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-60b055b9-3cf4-4bde-b410-e4a3c635a628 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:29.321318 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-60b055b9-3cf4-4bde-b410-e4a3c635a628 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:29.524484 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-60b055b9-3cf4-4bde-b410-e4a3c635a628 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:29.533260 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-60b055b9-3cf4-4bde-b410-e4a3c635a628 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb" status: 200 len: 1521 microversion: 2.1 time: 0.224992 Jun 16 12:28:29.543988 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 133/257] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:29 2022] GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:28:30.113169 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5bcc52cc-eea7-4eb0-ac23-8019a8f49484 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:30.114202 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5bcc52cc-eea7-4eb0-ac23-8019a8f49484 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] [instance: 2ebaa78e-5a30-4e1c-b96d-378dd8effe75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:30.120803 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5bcc52cc-eea7-4eb0-ac23-8019a8f49484 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:30.121577 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5bcc52cc-eea7-4eb0-ac23-8019a8f49484 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:30.123107 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5bcc52cc-eea7-4eb0-ac23-8019a8f49484 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:30.123725 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5bcc52cc-eea7-4eb0-ac23-8019a8f49484 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:30.372358 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5bcc52cc-eea7-4eb0-ac23-8019a8f49484 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c3afeab761e46569123b3a12158dcea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311ff745dcd4bddaba0a78f4597cd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:30.379927 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5bcc52cc-eea7-4eb0-ac23-8019a8f49484 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] 10.222.0.45 "GET /compute/v2.1/servers/2ebaa78e-5a30-4e1c-b96d-378dd8effe75" status: 200 len: 1315 microversion: 2.1 time: 0.270695 Jun 16 12:28:30.380583 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 125/258] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:30 2022] GET /compute/v2.1/servers/2ebaa78e-5a30-4e1c-b96d-378dd8effe75 => generated 1315 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:28:30.550791 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9753aa2b-cd41-4809-a60f-0d5d2a3ad023 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:30.551953 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9753aa2b-cd41-4809-a60f-0d5d2a3ad023 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c7405152-1807-4b2a-8701-ef2b2a8cbafb] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:30.557944 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9753aa2b-cd41-4809-a60f-0d5d2a3ad023 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:30.558402 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9753aa2b-cd41-4809-a60f-0d5d2a3ad023 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:30.559173 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9753aa2b-cd41-4809-a60f-0d5d2a3ad023 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:30.559686 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9753aa2b-cd41-4809-a60f-0d5d2a3ad023 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:30.698670 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9753aa2b-cd41-4809-a60f-0d5d2a3ad023 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:30.706870 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9753aa2b-cd41-4809-a60f-0d5d2a3ad023 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb" status: 200 len: 1521 microversion: 2.1 time: 0.159814 Jun 16 12:28:30.707448 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 134/259] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:30 2022] GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:28:31.397906 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0fa616e3-dec8-4ed3-b587-b26d59077ef0 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:31.399283 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0fa616e3-dec8-4ed3-b587-b26d59077ef0 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] [instance: 2ebaa78e-5a30-4e1c-b96d-378dd8effe75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:31.407227 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell0:SELECT=2 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:28:31.410658 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0fa616e3-dec8-4ed3-b587-b26d59077ef0 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:31.412040 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0fa616e3-dec8-4ed3-b587-b26d59077ef0 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:31.413562 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0fa616e3-dec8-4ed3-b587-b26d59077ef0 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:31.414390 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0fa616e3-dec8-4ed3-b587-b26d59077ef0 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:31.557496 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0fa616e3-dec8-4ed3-b587-b26d59077ef0 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c3afeab761e46569123b3a12158dcea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311ff745dcd4bddaba0a78f4597cd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:31.570656 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0fa616e3-dec8-4ed3-b587-b26d59077ef0 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] 10.222.0.45 "GET /compute/v2.1/servers/2ebaa78e-5a30-4e1c-b96d-378dd8effe75" status: 200 len: 1315 microversion: 2.1 time: 0.177478 Jun 16 12:28:31.571253 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 126/260] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:31 2022] GET /compute/v2.1/servers/2ebaa78e-5a30-4e1c-b96d-378dd8effe75 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:28:31.725160 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b7b6a799-dc5f-4bb8-977c-51a5bd20bb52 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:31.726634 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b7b6a799-dc5f-4bb8-977c-51a5bd20bb52 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c7405152-1807-4b2a-8701-ef2b2a8cbafb] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:31.729800 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=2 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:28:31.731014 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=6 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:28:31.744079 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b7b6a799-dc5f-4bb8-977c-51a5bd20bb52 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:31.744821 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b7b6a799-dc5f-4bb8-977c-51a5bd20bb52 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:31.745783 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b7b6a799-dc5f-4bb8-977c-51a5bd20bb52 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:31.746650 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b7b6a799-dc5f-4bb8-977c-51a5bd20bb52 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:32.020696 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b7b6a799-dc5f-4bb8-977c-51a5bd20bb52 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:32.028964 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b7b6a799-dc5f-4bb8-977c-51a5bd20bb52 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb" status: 200 len: 1521 microversion: 2.1 time: 0.308029 Jun 16 12:28:32.029614 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 135/261] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:31 2022] GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb => generated 1521 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:28:32.463597 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2c122eeb-4a3f-40f2-b76a-a6a46f06a20d tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:32.464951 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2c122eeb-4a3f-40f2-b76a-a6a46f06a20d tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] [instance: c72b39de-9695-4833-8a7a-76af4eaa33d4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:32.472403 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2c122eeb-4a3f-40f2-b76a-a6a46f06a20d tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:32.472959 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2c122eeb-4a3f-40f2-b76a-a6a46f06a20d tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:32.473848 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2c122eeb-4a3f-40f2-b76a-a6a46f06a20d tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:32.474423 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2c122eeb-4a3f-40f2-b76a-a6a46f06a20d tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:32.491089 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-2c122eeb-4a3f-40f2-b76a-a6a46f06a20d tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] HTTP exception thrown: Instance c72b39de-9695-4833-8a7a-76af4eaa33d4 could not be found. Jun 16 12:28:32.493713 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2c122eeb-4a3f-40f2-b76a-a6a46f06a20d tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Request method failure captured: Jun 16 12:28:32.493713 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: request: DELETE /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4 HTTP/1.1 Jun 16 12:28:32.493713 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Accept: application/json Jun 16 12:28:32.493713 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jun 16 12:28:32.493713 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Connection: close Jun 16 12:28:32.493713 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jun 16 12:28:32.493713 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jun 16 12:28:32.493713 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Host: 10.222.0.45 Jun 16 12:28:32.493713 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jun 16 12:28:32.493713 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jun 16 12:28:32.493713 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABiqyGH9mtQokQpQY6BjOxsC157_dv-gpOooiVVS5n5B_gMr0vBLjFLWXmczXrb9PSWjcH8SMzwdYYoylcgAE1ViZyEX8CGUnApXZVpoBgqUH11AYg8GtCnO6esZHrvX0FVGZgFy3hPhdE_WGgIkyxkORteR0fkMddlXr49tymIcP85G4M Jun 16 12:28:32.493713 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jun 16 12:28:32.493713 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jun 16 12:28:32.493713 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jun 16 12:28:32.493713 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jun 16 12:28:32.493713 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jun 16 12:28:32.493713 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jun 16 12:28:32.493713 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Id: a66000602298490b9e76d8138fdb825b Jun 16 12:28:32.493713 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-DeleteServersTestJSON-41721904 Jun 16 12:28:32.493713 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Role: member,reader Jun 16 12:28:32.493713 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Roles: member,reader Jun 16 12:28:32.495209 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a66000602298490b9e76d8138fdb825b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a66000602298490b9e76d8138fdb825b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a66000602298490b9e76d8138fdb825b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a66000602298490b9e76d8138fdb825b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Jun 16 12:28:32.495209 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-DeleteServersTestJSON-41721904 Jun 16 12:28:32.495209 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant-Id: a66000602298490b9e76d8138fdb825b Jun 16 12:28:32.495209 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-DeleteServersTestJSON-41721904 Jun 16 12:28:32.495209 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User: tempest-DeleteServersTestJSON-41721904-project Jun 16 12:28:32.495209 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jun 16 12:28:32.495209 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jun 16 12:28:32.495209 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Id: cf22beda54e24b878e514304e7a62b65 Jun 16 12:28:32.495209 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-DeleteServersTestJSON-41721904-project Jun 16 12:28:32.495209 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: method: > Jun 16 12:28:32.495209 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: exception: Instance c72b39de-9695-4833-8a7a-76af4eaa33d4 could not be found. Jun 16 12:28:32.495209 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: action_args: {'id': 'c72b39de-9695-4833-8a7a-76af4eaa33d4'} Jun 16 12:28:32.496027 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:28:32.496027 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:28:32.496027 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:28:32.496027 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:28:32.496027 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:28:32.496027 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:28:32.496027 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:28:32.496027 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:28:32.496027 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:28:32.496027 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:28:32.496027 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c72b39de-9695-4833-8a7a-76af4eaa33d4 could not be found. Jun 16 12:28:32.496027 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:28:32.496027 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:28:32.496027 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:28:32.496027 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:28:32.496027 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:28:32.496027 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:28:32.496027 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:28:32.496027 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:28:32.496027 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:28:32.497300 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:28:32.497300 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 12:28:32.497300 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 12:28:32.497300 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 12:28:32.497300 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 12:28:32.497300 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:28:32.497300 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:28:32.497300 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:28:32.497300 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:28:32.497300 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c72b39de-9695-4833-8a7a-76af4eaa33d4 could not be found. Jun 16 12:28:32.497300 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:28:32.497300 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:28:32.497300 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:28:32.497300 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:28:32.497300 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:28:32.497300 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:28:32.497300 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:28:32.497300 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:28:32.497300 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c72b39de-9695-4833-8a7a-76af4eaa33d4 could not be found. Jun 16 12:28:32.497300 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:28:32.499855 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2c122eeb-4a3f-40f2-b76a-a6a46f06a20d tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Returning 404 to user: Instance c72b39de-9695-4833-8a7a-76af4eaa33d4 could not be found. {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:28:32.501005 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2c122eeb-4a3f-40f2-b76a-a6a46f06a20d tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] 10.222.0.45 "DELETE /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4" status: 404 len: 111 microversion: 2.1 time: 0.042470 Jun 16 12:28:32.501653 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 127/262] 10.222.0.45 () {58 vars in 1238 bytes} [Thu Jun 16 12:28:32 2022] DELETE /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 12:28:32.509959 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-44c61437-6026-4f2e-98b1-2408f31ed393 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:32.510851 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-44c61437-6026-4f2e-98b1-2408f31ed393 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] [instance: c72b39de-9695-4833-8a7a-76af4eaa33d4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:32.518128 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-44c61437-6026-4f2e-98b1-2408f31ed393 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:32.518909 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-44c61437-6026-4f2e-98b1-2408f31ed393 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:32.520238 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-44c61437-6026-4f2e-98b1-2408f31ed393 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:32.520921 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-44c61437-6026-4f2e-98b1-2408f31ed393 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:32.541788 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-44c61437-6026-4f2e-98b1-2408f31ed393 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] HTTP exception thrown: Instance c72b39de-9695-4833-8a7a-76af4eaa33d4 could not be found. Jun 16 12:28:32.543472 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-44c61437-6026-4f2e-98b1-2408f31ed393 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Request method failure captured: Jun 16 12:28:32.543472 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: request: GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4 HTTP/1.1 Jun 16 12:28:32.543472 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 16 12:28:32.543472 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 16 12:28:32.543472 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Connection: close Jun 16 12:28:32.543472 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 16 12:28:32.543472 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 16 12:28:32.543472 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Host: 10.222.0.45 Jun 16 12:28:32.543472 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 16 12:28:32.543472 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 16 12:28:32.543472 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABiqyGH9mtQokQpQY6BjOxsC157_dv-gpOooiVVS5n5B_gMr0vBLjFLWXmczXrb9PSWjcH8SMzwdYYoylcgAE1ViZyEX8CGUnApXZVpoBgqUH11AYg8GtCnO6esZHrvX0FVGZgFy3hPhdE_WGgIkyxkORteR0fkMddlXr49tymIcP85G4M Jun 16 12:28:32.543472 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 16 12:28:32.543472 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 16 12:28:32.543472 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 16 12:28:32.543472 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 16 12:28:32.543472 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 16 12:28:32.543472 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 16 12:28:32.543472 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Id: a66000602298490b9e76d8138fdb825b Jun 16 12:28:32.543472 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-DeleteServersTestJSON-41721904 Jun 16 12:28:32.543472 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 16 12:28:32.543472 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 16 12:28:32.545702 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a66000602298490b9e76d8138fdb825b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a66000602298490b9e76d8138fdb825b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a66000602298490b9e76d8138fdb825b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a66000602298490b9e76d8138fdb825b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Jun 16 12:28:32.545702 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-DeleteServersTestJSON-41721904 Jun 16 12:28:32.545702 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant-Id: a66000602298490b9e76d8138fdb825b Jun 16 12:28:32.545702 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-DeleteServersTestJSON-41721904 Jun 16 12:28:32.545702 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User: tempest-DeleteServersTestJSON-41721904-project Jun 16 12:28:32.545702 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 16 12:28:32.545702 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 16 12:28:32.545702 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Id: cf22beda54e24b878e514304e7a62b65 Jun 16 12:28:32.545702 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-DeleteServersTestJSON-41721904-project Jun 16 12:28:32.545702 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: method: > Jun 16 12:28:32.545702 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: exception: Instance c72b39de-9695-4833-8a7a-76af4eaa33d4 could not be found. Jun 16 12:28:32.545702 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: action_args: {'id': 'c72b39de-9695-4833-8a7a-76af4eaa33d4'} Jun 16 12:28:32.546512 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:28:32.546512 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:28:32.546512 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:28:32.546512 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:28:32.546512 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:28:32.546512 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:28:32.546512 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:28:32.546512 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:28:32.546512 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:28:32.546512 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:28:32.546512 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c72b39de-9695-4833-8a7a-76af4eaa33d4 could not be found. Jun 16 12:28:32.546512 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:28:32.546512 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:28:32.546512 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:28:32.546512 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:28:32.546512 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:28:32.546512 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:28:32.546512 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:28:32.546512 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:28:32.546512 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:28:32.547774 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:28:32.547774 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 12:28:32.547774 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 12:28:32.547774 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:28:32.547774 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:28:32.547774 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:28:32.547774 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:28:32.547774 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c72b39de-9695-4833-8a7a-76af4eaa33d4 could not be found. Jun 16 12:28:32.547774 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:28:32.547774 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:28:32.547774 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:28:32.547774 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:28:32.547774 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:28:32.547774 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:28:32.547774 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:28:32.547774 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:28:32.547774 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c72b39de-9695-4833-8a7a-76af4eaa33d4 could not be found. Jun 16 12:28:32.547774 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:28:32.549051 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-44c61437-6026-4f2e-98b1-2408f31ed393 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] Returning 404 to user: Instance c72b39de-9695-4833-8a7a-76af4eaa33d4 could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:28:32.549051 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-44c61437-6026-4f2e-98b1-2408f31ed393 tempest-DeleteServersTestJSON-41721904 tempest-DeleteServersTestJSON-41721904-project] 10.222.0.45 "GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4" status: 404 len: 111 microversion: 2.1 time: 0.040362 Jun 16 12:28:32.550482 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 136/263] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:32 2022] GET /compute/v2.1/servers/c72b39de-9695-4833-8a7a-76af4eaa33d4 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 12:28:32.591193 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a522ff5a-ba07-4ef9-a4a6-cf83590e38f5 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:32.593819 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a522ff5a-ba07-4ef9-a4a6-cf83590e38f5 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] [instance: 2ebaa78e-5a30-4e1c-b96d-378dd8effe75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:32.608866 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a522ff5a-ba07-4ef9-a4a6-cf83590e38f5 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:32.612907 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a522ff5a-ba07-4ef9-a4a6-cf83590e38f5 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:32.613785 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a522ff5a-ba07-4ef9-a4a6-cf83590e38f5 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:32.614259 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a522ff5a-ba07-4ef9-a4a6-cf83590e38f5 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:32.973834 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a522ff5a-ba07-4ef9-a4a6-cf83590e38f5 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c3afeab761e46569123b3a12158dcea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311ff745dcd4bddaba0a78f4597cd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:32.985473 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a522ff5a-ba07-4ef9-a4a6-cf83590e38f5 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] 10.222.0.45 "GET /compute/v2.1/servers/2ebaa78e-5a30-4e1c-b96d-378dd8effe75" status: 200 len: 1315 microversion: 2.1 time: 0.401273 Jun 16 12:28:32.986745 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 128/264] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:32 2022] GET /compute/v2.1/servers/2ebaa78e-5a30-4e1c-b96d-378dd8effe75 => generated 1315 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:28:33.053425 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5454cbba-24f9-47f7-85c7-3d76b96053c8 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:33.057740 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5454cbba-24f9-47f7-85c7-3d76b96053c8 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c7405152-1807-4b2a-8701-ef2b2a8cbafb] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:33.077716 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5454cbba-24f9-47f7-85c7-3d76b96053c8 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:33.078711 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5454cbba-24f9-47f7-85c7-3d76b96053c8 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:33.082357 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5454cbba-24f9-47f7-85c7-3d76b96053c8 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:33.084230 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5454cbba-24f9-47f7-85c7-3d76b96053c8 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:33.682324 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5454cbba-24f9-47f7-85c7-3d76b96053c8 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:33.690632 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5454cbba-24f9-47f7-85c7-3d76b96053c8 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb" status: 200 len: 1521 microversion: 2.1 time: 0.647669 Jun 16 12:28:33.694255 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 137/265] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:33 2022] GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb => generated 1521 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:28:34.004819 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6648aa73-d4ce-405d-95bf-1407156ae55f tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:34.005578 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6648aa73-d4ce-405d-95bf-1407156ae55f tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] [instance: 2ebaa78e-5a30-4e1c-b96d-378dd8effe75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:34.024771 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6648aa73-d4ce-405d-95bf-1407156ae55f tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:34.027162 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6648aa73-d4ce-405d-95bf-1407156ae55f tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:34.032370 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6648aa73-d4ce-405d-95bf-1407156ae55f tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:34.033088 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6648aa73-d4ce-405d-95bf-1407156ae55f tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:34.692875 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6648aa73-d4ce-405d-95bf-1407156ae55f tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c3afeab761e46569123b3a12158dcea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311ff745dcd4bddaba0a78f4597cd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:34.701830 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6648aa73-d4ce-405d-95bf-1407156ae55f tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] 10.222.0.45 "GET /compute/v2.1/servers/2ebaa78e-5a30-4e1c-b96d-378dd8effe75" status: 200 len: 1315 microversion: 2.1 time: 0.701698 Jun 16 12:28:34.708348 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 129/266] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:33 2022] GET /compute/v2.1/servers/2ebaa78e-5a30-4e1c-b96d-378dd8effe75 => generated 1315 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:28:34.713969 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3a278fbc-e766-4ff9-88b6-dafcd0c58c58 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:34.714596 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3a278fbc-e766-4ff9-88b6-dafcd0c58c58 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c7405152-1807-4b2a-8701-ef2b2a8cbafb] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:34.729806 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3a278fbc-e766-4ff9-88b6-dafcd0c58c58 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:34.730304 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3a278fbc-e766-4ff9-88b6-dafcd0c58c58 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:34.731161 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3a278fbc-e766-4ff9-88b6-dafcd0c58c58 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:34.731690 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3a278fbc-e766-4ff9-88b6-dafcd0c58c58 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:35.466552 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3a278fbc-e766-4ff9-88b6-dafcd0c58c58 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:35.471433 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:28:35.480933 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3a278fbc-e766-4ff9-88b6-dafcd0c58c58 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb" status: 200 len: 1521 microversion: 2.1 time: 0.771365 Jun 16 12:28:35.481782 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 138/267] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:34 2022] GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb => generated 1521 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:28:35.721636 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-12357ac9-af6c-44e2-a3eb-1c0e8a2315a4 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:35.722322 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-12357ac9-af6c-44e2-a3eb-1c0e8a2315a4 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] [instance: 2ebaa78e-5a30-4e1c-b96d-378dd8effe75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:35.754515 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-12357ac9-af6c-44e2-a3eb-1c0e8a2315a4 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:35.755363 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-12357ac9-af6c-44e2-a3eb-1c0e8a2315a4 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:35.756391 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-12357ac9-af6c-44e2-a3eb-1c0e8a2315a4 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:35.757066 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-12357ac9-af6c-44e2-a3eb-1c0e8a2315a4 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:36.432872 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-12357ac9-af6c-44e2-a3eb-1c0e8a2315a4 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c3afeab761e46569123b3a12158dcea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311ff745dcd4bddaba0a78f4597cd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:36.444259 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-12357ac9-af6c-44e2-a3eb-1c0e8a2315a4 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] 10.222.0.45 "GET /compute/v2.1/servers/2ebaa78e-5a30-4e1c-b96d-378dd8effe75" status: 200 len: 1315 microversion: 2.1 time: 0.726648 Jun 16 12:28:36.447450 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 130/268] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:35 2022] GET /compute/v2.1/servers/2ebaa78e-5a30-4e1c-b96d-378dd8effe75 => generated 1315 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:28:36.499673 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fef74ec7-4b8b-4676-85e0-ac4648a8dad0 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:36.500963 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-fef74ec7-4b8b-4676-85e0-ac4648a8dad0 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c7405152-1807-4b2a-8701-ef2b2a8cbafb] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:36.519538 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fef74ec7-4b8b-4676-85e0-ac4648a8dad0 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:36.526627 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fef74ec7-4b8b-4676-85e0-ac4648a8dad0 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:36.531656 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fef74ec7-4b8b-4676-85e0-ac4648a8dad0 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:36.533522 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fef74ec7-4b8b-4676-85e0-ac4648a8dad0 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:37.383409 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fef74ec7-4b8b-4676-85e0-ac4648a8dad0 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:37.391788 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-fef74ec7-4b8b-4676-85e0-ac4648a8dad0 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb" status: 200 len: 1521 microversion: 2.1 time: 0.897675 Jun 16 12:28:37.401399 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 139/269] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:36 2022] GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb => generated 1521 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:28:37.463930 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a2d16946-40c6-46d5-8ef0-bb3eb5ded9f6 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:37.464709 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a2d16946-40c6-46d5-8ef0-bb3eb5ded9f6 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] [instance: 2ebaa78e-5a30-4e1c-b96d-378dd8effe75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:37.473242 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a2d16946-40c6-46d5-8ef0-bb3eb5ded9f6 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:37.478583 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a2d16946-40c6-46d5-8ef0-bb3eb5ded9f6 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:37.479637 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a2d16946-40c6-46d5-8ef0-bb3eb5ded9f6 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:37.480237 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a2d16946-40c6-46d5-8ef0-bb3eb5ded9f6 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:37.937378 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a2d16946-40c6-46d5-8ef0-bb3eb5ded9f6 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c3afeab761e46569123b3a12158dcea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311ff745dcd4bddaba0a78f4597cd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:37.945544 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a2d16946-40c6-46d5-8ef0-bb3eb5ded9f6 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] 10.222.0.45 "GET /compute/v2.1/servers/2ebaa78e-5a30-4e1c-b96d-378dd8effe75" status: 200 len: 1315 microversion: 2.1 time: 0.485766 Jun 16 12:28:37.946072 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 131/270] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:37 2022] GET /compute/v2.1/servers/2ebaa78e-5a30-4e1c-b96d-378dd8effe75 => generated 1315 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:28:38.236640 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-c9e671da-edf8-409f-9fab-099070b030ea req-0f9b7192-b46b-4123-92b1-cabdff00d52d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ebaa78e-5a30-4e1c-b96d-378dd8effe75", "name": "network-vif-plugged", "status": "completed", "tag": "11e2a024-84a4-4729-b062-5e10d0658fed"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:28:38.245103 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-c9e671da-edf8-409f-9fab-099070b030ea req-0f9b7192-b46b-4123-92b1-cabdff00d52d service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:38.245601 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-c9e671da-edf8-409f-9fab-099070b030ea req-0f9b7192-b46b-4123-92b1-cabdff00d52d service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:38.279639 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-c9e671da-edf8-409f-9fab-099070b030ea req-0f9b7192-b46b-4123-92b1-cabdff00d52d service nova] Creating event network-vif-plugged:11e2a024-84a4-4729-b062-5e10d0658fed for instance 2ebaa78e-5a30-4e1c-b96d-378dd8effe75 on hv-cinder-84614 Jun 16 12:28:38.286177 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-c9e671da-edf8-409f-9fab-099070b030ea req-0f9b7192-b46b-4123-92b1-cabdff00d52d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052890 Jun 16 12:28:38.287228 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 140/271] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:28:38.419603 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a56c548d-6076-4ee9-b84e-b0fb39d8603f tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:38.421797 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a56c548d-6076-4ee9-b84e-b0fb39d8603f tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c7405152-1807-4b2a-8701-ef2b2a8cbafb] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:38.435765 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a56c548d-6076-4ee9-b84e-b0fb39d8603f tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:38.436218 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a56c548d-6076-4ee9-b84e-b0fb39d8603f tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:38.436998 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a56c548d-6076-4ee9-b84e-b0fb39d8603f tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:38.437433 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a56c548d-6076-4ee9-b84e-b0fb39d8603f tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:38.963649 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-55c8a1be-24aa-4b90-a71a-01d879c743ad tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:38.964620 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-55c8a1be-24aa-4b90-a71a-01d879c743ad tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] [instance: 2ebaa78e-5a30-4e1c-b96d-378dd8effe75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:38.987973 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-55c8a1be-24aa-4b90-a71a-01d879c743ad tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:38.989221 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-55c8a1be-24aa-4b90-a71a-01d879c743ad tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:38.990240 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-55c8a1be-24aa-4b90-a71a-01d879c743ad tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:38.990843 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-55c8a1be-24aa-4b90-a71a-01d879c743ad tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:38.991008 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a56c548d-6076-4ee9-b84e-b0fb39d8603f tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:39.003492 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a56c548d-6076-4ee9-b84e-b0fb39d8603f tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb" status: 200 len: 1521 microversion: 2.1 time: 0.597416 Jun 16 12:28:39.013185 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 132/272] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:38 2022] GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb => generated 1521 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:28:39.316726 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-55c8a1be-24aa-4b90-a71a-01d879c743ad tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c3afeab761e46569123b3a12158dcea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311ff745dcd4bddaba0a78f4597cd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:39.323780 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-55c8a1be-24aa-4b90-a71a-01d879c743ad tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] 10.222.0.45 "GET /compute/v2.1/servers/2ebaa78e-5a30-4e1c-b96d-378dd8effe75" status: 200 len: 1315 microversion: 2.1 time: 0.364357 Jun 16 12:28:39.324342 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 141/273] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:38 2022] GET /compute/v2.1/servers/2ebaa78e-5a30-4e1c-b96d-378dd8effe75 => generated 1315 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:28:40.021599 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ccf67547-9b0d-44c2-895d-86d78a6f4ad1 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:40.023359 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ccf67547-9b0d-44c2-895d-86d78a6f4ad1 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c7405152-1807-4b2a-8701-ef2b2a8cbafb] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:40.034129 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:28:40.041329 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ccf67547-9b0d-44c2-895d-86d78a6f4ad1 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:40.043314 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ccf67547-9b0d-44c2-895d-86d78a6f4ad1 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:40.046930 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ccf67547-9b0d-44c2-895d-86d78a6f4ad1 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:40.055191 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ccf67547-9b0d-44c2-895d-86d78a6f4ad1 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:40.295884 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ccf67547-9b0d-44c2-895d-86d78a6f4ad1 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:40.304924 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ccf67547-9b0d-44c2-895d-86d78a6f4ad1 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb" status: 200 len: 1521 microversion: 2.1 time: 0.287950 Jun 16 12:28:40.306552 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 133/274] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:40 2022] GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb => generated 1521 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:28:40.341921 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1b04c4d6-4638-4d51-8a2d-b4dcdb6bf08d tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:40.343557 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1b04c4d6-4638-4d51-8a2d-b4dcdb6bf08d tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] [instance: 2ebaa78e-5a30-4e1c-b96d-378dd8effe75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:40.359026 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1b04c4d6-4638-4d51-8a2d-b4dcdb6bf08d tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:40.360118 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1b04c4d6-4638-4d51-8a2d-b4dcdb6bf08d tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:40.361785 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1b04c4d6-4638-4d51-8a2d-b4dcdb6bf08d tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:40.366935 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1b04c4d6-4638-4d51-8a2d-b4dcdb6bf08d tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:40.630217 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1b04c4d6-4638-4d51-8a2d-b4dcdb6bf08d tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c3afeab761e46569123b3a12158dcea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311ff745dcd4bddaba0a78f4597cd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:40.644251 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1b04c4d6-4638-4d51-8a2d-b4dcdb6bf08d tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] 10.222.0.45 "GET /compute/v2.1/servers/2ebaa78e-5a30-4e1c-b96d-378dd8effe75" status: 200 len: 1315 microversion: 2.1 time: 0.307638 Jun 16 12:28:40.654996 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 142/275] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:40 2022] GET /compute/v2.1/servers/2ebaa78e-5a30-4e1c-b96d-378dd8effe75 => generated 1315 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:28:41.328627 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-89faccf7-c1ec-4672-898b-e2a41186b1fc tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:41.329260 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-89faccf7-c1ec-4672-898b-e2a41186b1fc tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c7405152-1807-4b2a-8701-ef2b2a8cbafb] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:41.344806 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-89faccf7-c1ec-4672-898b-e2a41186b1fc tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:41.345280 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-89faccf7-c1ec-4672-898b-e2a41186b1fc tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:41.351067 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-89faccf7-c1ec-4672-898b-e2a41186b1fc tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:41.351834 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-89faccf7-c1ec-4672-898b-e2a41186b1fc tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:41.406909 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:28:41.603883 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-89faccf7-c1ec-4672-898b-e2a41186b1fc tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:41.615193 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-89faccf7-c1ec-4672-898b-e2a41186b1fc tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb" status: 200 len: 1521 microversion: 2.1 time: 0.294033 Jun 16 12:28:41.618941 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 134/276] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:41 2022] GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb => generated 1521 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:28:41.661746 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-60606c2a-6ed2-4e65-a1e9-b58bdbf62a16 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:41.662396 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-60606c2a-6ed2-4e65-a1e9-b58bdbf62a16 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] [instance: 2ebaa78e-5a30-4e1c-b96d-378dd8effe75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:41.669037 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-60606c2a-6ed2-4e65-a1e9-b58bdbf62a16 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:41.669649 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-60606c2a-6ed2-4e65-a1e9-b58bdbf62a16 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:41.670571 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-60606c2a-6ed2-4e65-a1e9-b58bdbf62a16 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:41.671011 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-60606c2a-6ed2-4e65-a1e9-b58bdbf62a16 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:42.020145 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-60606c2a-6ed2-4e65-a1e9-b58bdbf62a16 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c3afeab761e46569123b3a12158dcea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311ff745dcd4bddaba0a78f4597cd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:42.040792 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-60606c2a-6ed2-4e65-a1e9-b58bdbf62a16 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] 10.222.0.45 "GET /compute/v2.1/servers/2ebaa78e-5a30-4e1c-b96d-378dd8effe75" status: 200 len: 1465 microversion: 2.1 time: 0.383066 Jun 16 12:28:42.041840 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 143/277] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:41 2022] GET /compute/v2.1/servers/2ebaa78e-5a30-4e1c-b96d-378dd8effe75 => generated 1465 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:28:42.132789 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c88f6f9b-26b4-4850-9459-f6070cfcb952 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:42.133401 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c88f6f9b-26b4-4850-9459-f6070cfcb952 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] [instance: 2ebaa78e-5a30-4e1c-b96d-378dd8effe75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:42.142098 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c88f6f9b-26b4-4850-9459-f6070cfcb952 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:42.144809 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c88f6f9b-26b4-4850-9459-f6070cfcb952 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:42.145758 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c88f6f9b-26b4-4850-9459-f6070cfcb952 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:42.148984 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c88f6f9b-26b4-4850-9459-f6070cfcb952 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:42.207606 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c88f6f9b-26b4-4850-9459-f6070cfcb952 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] [instance: 2ebaa78e-5a30-4e1c-b96d-378dd8effe75] Going to try to terminate instance {{(pid=117607) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 12:28:42.345260 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c88f6f9b-26b4-4850-9459-f6070cfcb952 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] 10.222.0.45 "DELETE /compute/v2.1/servers/2ebaa78e-5a30-4e1c-b96d-378dd8effe75" status: 204 len: 0 microversion: 2.1 time: 0.216078 Jun 16 12:28:42.350625 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 135/278] 10.222.0.45 () {58 vars in 1238 bytes} [Thu Jun 16 12:28:42 2022] DELETE /compute/v2.1/servers/2ebaa78e-5a30-4e1c-b96d-378dd8effe75 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 12:28:42.372980 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-9a524267-6dcd-495a-92e5-7560ee5312e3 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:42.374039 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-9a524267-6dcd-495a-92e5-7560ee5312e3 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] [instance: 2ebaa78e-5a30-4e1c-b96d-378dd8effe75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:42.387803 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9a524267-6dcd-495a-92e5-7560ee5312e3 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:42.388585 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9a524267-6dcd-495a-92e5-7560ee5312e3 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:42.389637 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9a524267-6dcd-495a-92e5-7560ee5312e3 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:42.390365 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9a524267-6dcd-495a-92e5-7560ee5312e3 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:42.547815 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b43f279a-33e3-43ee-9177-b3c4728a6651 tempest-VolumesGetTestJSON-1988511234 tempest-VolumesGetTestJSON-1988511234-project] Action: 'create', calling method: .version_select at 0x7f7c723431f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1615186363", "metadata": {"Type": "work"}}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:28:42.656916 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-9a524267-6dcd-495a-92e5-7560ee5312e3 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c3afeab761e46569123b3a12158dcea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311ff745dcd4bddaba0a78f4597cd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:42.674232 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-9a524267-6dcd-495a-92e5-7560ee5312e3 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] 10.222.0.45 "GET /compute/v2.1/servers/2ebaa78e-5a30-4e1c-b96d-378dd8effe75" status: 200 len: 1471 microversion: 2.1 time: 0.321782 Jun 16 12:28:42.675071 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 136/279] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:42 2022] GET /compute/v2.1/servers/2ebaa78e-5a30-4e1c-b96d-378dd8effe75 => generated 1471 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:28:42.681743 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-80eae32b-c77f-499c-b80f-2f5d6cd80f82 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:42.682448 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-80eae32b-c77f-499c-b80f-2f5d6cd80f82 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c7405152-1807-4b2a-8701-ef2b2a8cbafb] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:42.691489 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-80eae32b-c77f-499c-b80f-2f5d6cd80f82 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:42.692359 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-80eae32b-c77f-499c-b80f-2f5d6cd80f82 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:42.693429 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-80eae32b-c77f-499c-b80f-2f5d6cd80f82 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:42.694343 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-80eae32b-c77f-499c-b80f-2f5d6cd80f82 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:42.927192 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-80eae32b-c77f-499c-b80f-2f5d6cd80f82 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:42.940814 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-80eae32b-c77f-499c-b80f-2f5d6cd80f82 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb" status: 200 len: 1521 microversion: 2.1 time: 0.263934 Jun 16 12:28:42.941512 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 137/280] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:42 2022] GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:28:43.032965 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b43f279a-33e3-43ee-9177-b3c4728a6651 tempest-VolumesGetTestJSON-1988511234 tempest-VolumesGetTestJSON-1988511234-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.755500 Jun 16 12:28:43.039734 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 144/281] 10.222.0.45 () {60 vars in 1155 bytes} [Thu Jun 16 12:28:42 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 759 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 16 12:28:43.050397 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-11b5d050-a7f7-465b-a418-4e1d6fcea41a tempest-VolumesGetTestJSON-1988511234 tempest-VolumesGetTestJSON-1988511234-project] Calling method '.version_select at 0x7f7c72b298b0>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:43.113374 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-11b5d050-a7f7-465b-a418-4e1d6fcea41a tempest-VolumesGetTestJSON-1988511234 tempest-VolumesGetTestJSON-1988511234-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/e4fb2e92-27bc-4794-9da0-7a33f1de06e0" status: 200 len: 353 microversion: 2.1 time: 0.071337 Jun 16 12:28:43.119245 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 138/282] 10.222.0.45 () {58 vars in 1244 bytes} [Thu Jun 16 12:28:43 2022] GET /compute/v2.1/os-volumes/e4fb2e92-27bc-4794-9da0-7a33f1de06e0 => generated 353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:28:43.691336 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b02e0db3-1ef0-466d-aeaf-13878d74f4f5 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:43.692236 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b02e0db3-1ef0-466d-aeaf-13878d74f4f5 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] [instance: 2ebaa78e-5a30-4e1c-b96d-378dd8effe75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:43.694464 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:28:43.701715 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b02e0db3-1ef0-466d-aeaf-13878d74f4f5 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:43.702179 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b02e0db3-1ef0-466d-aeaf-13878d74f4f5 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:43.702959 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b02e0db3-1ef0-466d-aeaf-13878d74f4f5 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:43.703507 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b02e0db3-1ef0-466d-aeaf-13878d74f4f5 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:43.870018 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b02e0db3-1ef0-466d-aeaf-13878d74f4f5 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c3afeab761e46569123b3a12158dcea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311ff745dcd4bddaba0a78f4597cd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:43.879769 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b02e0db3-1ef0-466d-aeaf-13878d74f4f5 tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] 10.222.0.45 "GET /compute/v2.1/servers/2ebaa78e-5a30-4e1c-b96d-378dd8effe75" status: 200 len: 1471 microversion: 2.1 time: 0.192204 Jun 16 12:28:43.885060 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 145/283] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:43 2022] GET /compute/v2.1/servers/2ebaa78e-5a30-4e1c-b96d-378dd8effe75 => generated 1471 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:28:43.959125 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3c4af732-d82e-43de-988d-4b6581c21a78 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:43.959710 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3c4af732-d82e-43de-988d-4b6581c21a78 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c7405152-1807-4b2a-8701-ef2b2a8cbafb] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:43.966792 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3c4af732-d82e-43de-988d-4b6581c21a78 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:43.967240 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3c4af732-d82e-43de-988d-4b6581c21a78 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:43.968001 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3c4af732-d82e-43de-988d-4b6581c21a78 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:43.968429 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3c4af732-d82e-43de-988d-4b6581c21a78 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:44.130314 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7e3686f9-c98e-4e5d-b6b0-fdc6cbe23fe1 tempest-VolumesGetTestJSON-1988511234 tempest-VolumesGetTestJSON-1988511234-project] Calling method '.version_select at 0x7f7c7247f670>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:44.180843 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-3c4af732-d82e-43de-988d-4b6581c21a78 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:44.195713 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3c4af732-d82e-43de-988d-4b6581c21a78 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb" status: 200 len: 1521 microversion: 2.1 time: 0.240771 Jun 16 12:28:44.208165 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 139/284] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:43 2022] GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:28:44.241575 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7e3686f9-c98e-4e5d-b6b0-fdc6cbe23fe1 tempest-VolumesGetTestJSON-1988511234 tempest-VolumesGetTestJSON-1988511234-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/e4fb2e92-27bc-4794-9da0-7a33f1de06e0" status: 200 len: 354 microversion: 2.1 time: 0.117126 Jun 16 12:28:44.243361 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 146/285] 10.222.0.45 () {58 vars in 1244 bytes} [Thu Jun 16 12:28:44 2022] GET /compute/v2.1/os-volumes/e4fb2e92-27bc-4794-9da0-7a33f1de06e0 => generated 354 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:28:44.255460 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-18704a23-6d1e-4ca8-808b-5912d55cbed6 tempest-VolumesGetTestJSON-1988511234 tempest-VolumesGetTestJSON-1988511234-project] Calling method '.version_select at 0x7f7c72b31790>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:44.313344 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-18704a23-6d1e-4ca8-808b-5912d55cbed6 tempest-VolumesGetTestJSON-1988511234 tempest-VolumesGetTestJSON-1988511234-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/e4fb2e92-27bc-4794-9da0-7a33f1de06e0" status: 200 len: 354 microversion: 2.1 time: 0.061986 Jun 16 12:28:44.315661 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 140/286] 10.222.0.45 () {58 vars in 1244 bytes} [Thu Jun 16 12:28:44 2022] GET /compute/v2.1/os-volumes/e4fb2e92-27bc-4794-9da0-7a33f1de06e0 => generated 354 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:28:44.332964 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9dfdfa6d-6158-4add-a102-c84c9c4c5f66 tempest-VolumesGetTestJSON-1988511234 tempest-VolumesGetTestJSON-1988511234-project] Calling method '.version_select at 0x7f7c72343550>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:44.448017 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9dfdfa6d-6158-4add-a102-c84c9c4c5f66 tempest-VolumesGetTestJSON-1988511234 tempest-VolumesGetTestJSON-1988511234-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/e4fb2e92-27bc-4794-9da0-7a33f1de06e0" status: 202 len: 0 microversion: 2.1 time: 0.118781 Jun 16 12:28:44.449328 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 147/287] 10.222.0.45 () {58 vars in 1247 bytes} [Thu Jun 16 12:28:44 2022] DELETE /compute/v2.1/os-volumes/e4fb2e92-27bc-4794-9da0-7a33f1de06e0 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 12:28:44.463679 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2a5f6866-3ea8-4b83-a102-3686a5d85ced tempest-VolumesGetTestJSON-1988511234 tempest-VolumesGetTestJSON-1988511234-project] Calling method '.version_select at 0x7f7c72b31430>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:44.552447 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2a5f6866-3ea8-4b83-a102-3686a5d85ced tempest-VolumesGetTestJSON-1988511234 tempest-VolumesGetTestJSON-1988511234-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/e4fb2e92-27bc-4794-9da0-7a33f1de06e0" status: 200 len: 353 microversion: 2.1 time: 0.097980 Jun 16 12:28:44.554626 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 141/288] 10.222.0.45 () {58 vars in 1244 bytes} [Thu Jun 16 12:28:44 2022] GET /compute/v2.1/os-volumes/e4fb2e92-27bc-4794-9da0-7a33f1de06e0 => generated 353 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 12:28:44.909571 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fa9c5e65-0046-4f5c-827c-5f0539ec7ffc tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:44.910720 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-fa9c5e65-0046-4f5c-827c-5f0539ec7ffc tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] [instance: 2ebaa78e-5a30-4e1c-b96d-378dd8effe75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:44.925137 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fa9c5e65-0046-4f5c-827c-5f0539ec7ffc tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:44.925965 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fa9c5e65-0046-4f5c-827c-5f0539ec7ffc tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:44.926909 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fa9c5e65-0046-4f5c-827c-5f0539ec7ffc tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:44.927668 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fa9c5e65-0046-4f5c-827c-5f0539ec7ffc tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:45.007924 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fa9c5e65-0046-4f5c-827c-5f0539ec7ffc tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c3afeab761e46569123b3a12158dcea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311ff745dcd4bddaba0a78f4597cd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:45.022031 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-fa9c5e65-0046-4f5c-827c-5f0539ec7ffc tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] 10.222.0.45 "GET /compute/v2.1/servers/2ebaa78e-5a30-4e1c-b96d-378dd8effe75" status: 200 len: 1429 microversion: 2.1 time: 0.117617 Jun 16 12:28:45.022685 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 148/289] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:44 2022] GET /compute/v2.1/servers/2ebaa78e-5a30-4e1c-b96d-378dd8effe75 => generated 1429 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:28:45.087017 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-7199b369-c5d6-443e-8d4a-bff2a17fdfa6 req-b3fd929e-f9e5-4fff-903a-35b8438db413 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ebaa78e-5a30-4e1c-b96d-378dd8effe75", "name": "network-vif-deleted", "tag": "11e2a024-84a4-4729-b062-5e10d0658fed"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:28:45.102408 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-7199b369-c5d6-443e-8d4a-bff2a17fdfa6 req-b3fd929e-f9e5-4fff-903a-35b8438db413 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:45.102867 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-7199b369-c5d6-443e-8d4a-bff2a17fdfa6 req-b3fd929e-f9e5-4fff-903a-35b8438db413 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:45.131793 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-7199b369-c5d6-443e-8d4a-bff2a17fdfa6 req-b3fd929e-f9e5-4fff-903a-35b8438db413 service nova] Creating event network-vif-deleted:11e2a024-84a4-4729-b062-5e10d0658fed for instance 2ebaa78e-5a30-4e1c-b96d-378dd8effe75 on hv-cinder-84614 Jun 16 12:28:45.138578 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-7199b369-c5d6-443e-8d4a-bff2a17fdfa6 req-b3fd929e-f9e5-4fff-903a-35b8438db413 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055547 Jun 16 12:28:45.139769 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 142/290] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:28:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:28:45.213696 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4f2bc40b-cead-4232-a302-4f662a8fcedf tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:45.215287 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4f2bc40b-cead-4232-a302-4f662a8fcedf tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c7405152-1807-4b2a-8701-ef2b2a8cbafb] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:45.222339 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4f2bc40b-cead-4232-a302-4f662a8fcedf tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:45.223114 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4f2bc40b-cead-4232-a302-4f662a8fcedf tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:45.224111 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4f2bc40b-cead-4232-a302-4f662a8fcedf tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:45.224551 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4f2bc40b-cead-4232-a302-4f662a8fcedf tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:45.567253 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-746acf8e-48ff-4b18-b52b-6e48cf577068 tempest-VolumesGetTestJSON-1988511234 tempest-VolumesGetTestJSON-1988511234-project] Calling method '.version_select at 0x7f7c72dcf1f0>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:45.608440 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-746acf8e-48ff-4b18-b52b-6e48cf577068 tempest-VolumesGetTestJSON-1988511234 tempest-VolumesGetTestJSON-1988511234-project] HTTP exception thrown: Volume e4fb2e92-27bc-4794-9da0-7a33f1de06e0 could not be found. Jun 16 12:28:45.612165 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-746acf8e-48ff-4b18-b52b-6e48cf577068 tempest-VolumesGetTestJSON-1988511234 tempest-VolumesGetTestJSON-1988511234-project] Request method failure captured: Jun 16 12:28:45.612165 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: request: GET /compute/v2.1/os-volumes/e4fb2e92-27bc-4794-9da0-7a33f1de06e0 HTTP/1.1 Jun 16 12:28:45.612165 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Accept: application/json Jun 16 12:28:45.612165 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jun 16 12:28:45.612165 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Connection: close Jun 16 12:28:45.612165 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jun 16 12:28:45.612165 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jun 16 12:28:45.612165 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Host: 10.222.0.45 Jun 16 12:28:45.612165 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jun 16 12:28:45.612165 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jun 16 12:28:45.612165 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABiqyH6fJ7SHtGFmWNMtvr35uhFuNfx-lSrCjV4n0wBR73lB-Pkxi6FjFrbgqJJFlecTSbPnH1pJScxd5hOHZK86PqnSUA4VNEH4Gvpnn_l0OZetF2E0K0Q8sq4W4v-ZAc7B3mSPTBHbHRUIlg5lpx6qjfeukMR7-K05L8oezlsv62NXf0 Jun 16 12:28:45.612165 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jun 16 12:28:45.612165 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jun 16 12:28:45.612165 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jun 16 12:28:45.612165 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jun 16 12:28:45.612165 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jun 16 12:28:45.612165 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jun 16 12:28:45.612165 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Id: 265b6bc1d76344798299c8ea05402a64 Jun 16 12:28:45.612165 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-VolumesGetTestJSON-1988511234 Jun 16 12:28:45.612165 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Role: member,reader Jun 16 12:28:45.612165 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Roles: member,reader Jun 16 12:28:45.613480 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/265b6bc1d76344798299c8ea05402a64"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/265b6bc1d76344798299c8ea05402a64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_265b6bc1d76344798299c8ea05402a64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/265b6bc1d76344798299c8ea05402a64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Jun 16 12:28:45.613480 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-VolumesGetTestJSON-1988511234 Jun 16 12:28:45.613480 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant-Id: 265b6bc1d76344798299c8ea05402a64 Jun 16 12:28:45.613480 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-VolumesGetTestJSON-1988511234 Jun 16 12:28:45.613480 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User: tempest-VolumesGetTestJSON-1988511234-project Jun 16 12:28:45.613480 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jun 16 12:28:45.613480 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jun 16 12:28:45.613480 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Id: 898ae1253b8545bab7e48724ef26a2dd Jun 16 12:28:45.613480 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-VolumesGetTestJSON-1988511234-project Jun 16 12:28:45.613480 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: method: Jun 16 12:28:45.613480 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: exception: Volume e4fb2e92-27bc-4794-9da0-7a33f1de06e0 could not be found. Jun 16 12:28:45.613480 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: action_args: {'id': 'e4fb2e92-27bc-4794-9da0-7a33f1de06e0'} Jun 16 12:28:45.613480 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:28:45.614837 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:28:45.614837 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 12:28:45.614837 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 12:28:45.614837 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 12:28:45.614837 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 12:28:45.614837 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 12:28:45.614837 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 12:28:45.614837 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 12:28:45.614837 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 12:28:45.614837 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 12:28:45.614837 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 12:28:45.614837 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 12:28:45.614837 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 12:28:45.614837 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 12:28:45.614837 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 12:28:45.614837 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e4fb2e92-27bc-4794-9da0-7a33f1de06e0 could not be found. (HTTP 404) (Request-ID: req-3b7aefd4-cb2c-474e-a2c7-7f85ef056465) Jun 16 12:28:45.614837 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:28:45.614837 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:28:45.614837 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:28:45.616347 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:28:45.616347 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 12:28:45.616347 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 12:28:45.616347 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 12:28:45.616347 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 12:28:45.616347 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 12:28:45.616347 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 12:28:45.616347 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 12:28:45.616347 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 12:28:45.616347 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 12:28:45.616347 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 12:28:45.616347 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 12:28:45.616347 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 12:28:45.616347 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 12:28:45.616347 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 12:28:45.616347 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 12:28:45.616347 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 12:28:45.616347 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 12:28:45.616347 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 12:28:45.617802 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 12:28:45.617802 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 12:28:45.617802 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 12:28:45.617802 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 12:28:45.617802 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e4fb2e92-27bc-4794-9da0-7a33f1de06e0 could not be found. Jun 16 12:28:45.617802 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:28:45.617802 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:28:45.617802 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:28:45.617802 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:28:45.617802 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:28:45.617802 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:28:45.617802 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:28:45.617802 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:28:45.617802 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 12:28:45.617802 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 12:28:45.617802 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:28:45.617802 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:28:45.617802 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 12:28:45.617802 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:28:45.619222 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e4fb2e92-27bc-4794-9da0-7a33f1de06e0 could not be found. Jun 16 12:28:45.619222 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:28:45.619222 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:28:45.619222 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:28:45.619222 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:28:45.619222 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:28:45.619222 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:28:45.619222 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:28:45.619222 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:28:45.619222 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e4fb2e92-27bc-4794-9da0-7a33f1de06e0 could not be found. Jun 16 12:28:45.619222 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:28:45.619222 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-746acf8e-48ff-4b18-b52b-6e48cf577068 tempest-VolumesGetTestJSON-1988511234 tempest-VolumesGetTestJSON-1988511234-project] Returning 404 to user: Volume e4fb2e92-27bc-4794-9da0-7a33f1de06e0 could not be found. {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:28:45.619222 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-746acf8e-48ff-4b18-b52b-6e48cf577068 tempest-VolumesGetTestJSON-1988511234 tempest-VolumesGetTestJSON-1988511234-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/e4fb2e92-27bc-4794-9da0-7a33f1de06e0" status: 404 len: 109 microversion: 2.1 time: 0.051220 Jun 16 12:28:45.619222 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 143/291] 10.222.0.45 () {58 vars in 1244 bytes} [Thu Jun 16 12:28:45 2022] GET /compute/v2.1/os-volumes/e4fb2e92-27bc-4794-9da0-7a33f1de06e0 => generated 109 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 12:28:45.706094 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4f2bc40b-cead-4232-a302-4f662a8fcedf tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:45.718309 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4f2bc40b-cead-4232-a302-4f662a8fcedf tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb" status: 200 len: 1521 microversion: 2.1 time: 0.508785 Jun 16 12:28:45.728987 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 149/292] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:45 2022] GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb => generated 1521 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:28:46.044635 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1e0790bc-2a16-4934-8653-27442660984a tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:46.045529 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1e0790bc-2a16-4934-8653-27442660984a tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] [instance: 2ebaa78e-5a30-4e1c-b96d-378dd8effe75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:46.053724 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1e0790bc-2a16-4934-8653-27442660984a tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:46.057749 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1e0790bc-2a16-4934-8653-27442660984a tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:46.059190 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1e0790bc-2a16-4934-8653-27442660984a tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:46.059803 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1e0790bc-2a16-4934-8653-27442660984a tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:46.077751 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-1e0790bc-2a16-4934-8653-27442660984a tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] HTTP exception thrown: Instance 2ebaa78e-5a30-4e1c-b96d-378dd8effe75 could not be found. Jun 16 12:28:46.079793 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1e0790bc-2a16-4934-8653-27442660984a tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Request method failure captured: Jun 16 12:28:46.079793 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: request: GET /compute/v2.1/servers/2ebaa78e-5a30-4e1c-b96d-378dd8effe75 HTTP/1.1 Jun 16 12:28:46.079793 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Accept: application/json Jun 16 12:28:46.079793 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jun 16 12:28:46.079793 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Connection: close Jun 16 12:28:46.079793 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jun 16 12:28:46.079793 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jun 16 12:28:46.079793 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Host: 10.222.0.45 Jun 16 12:28:46.079793 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jun 16 12:28:46.079793 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jun 16 12:28:46.079793 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABiqyHi4U4XcGfp_Fbb25PzUCSIW1BZ0YyJv9ns5K3PLa947T32x-liX73-xfn72OF2lR88CZ6Cr-LoVwP_mCVNXu0hUpTt_oS44ANdvFodfgESkDES2fZzoxQwgYe_w0HUmVllYjZ-9ZK9ApMFqlVhiFmzAQnu8qqcc0TTwDXKjX_x7ho Jun 16 12:28:46.079793 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jun 16 12:28:46.079793 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jun 16 12:28:46.079793 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jun 16 12:28:46.079793 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jun 16 12:28:46.079793 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jun 16 12:28:46.079793 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jun 16 12:28:46.079793 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Id: 6311ff745dcd4bddaba0a78f4597cd0c Jun 16 12:28:46.079793 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-VolumesNegativeTest-1224733431 Jun 16 12:28:46.079793 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Role: member,reader Jun 16 12:28:46.079793 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Roles: member,reader Jun 16 12:28:46.081240 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/6311ff745dcd4bddaba0a78f4597cd0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6311ff745dcd4bddaba0a78f4597cd0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_6311ff745dcd4bddaba0a78f4597cd0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6311ff745dcd4bddaba0a78f4597cd0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Jun 16 12:28:46.081240 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-VolumesNegativeTest-1224733431 Jun 16 12:28:46.081240 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant-Id: 6311ff745dcd4bddaba0a78f4597cd0c Jun 16 12:28:46.081240 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-VolumesNegativeTest-1224733431 Jun 16 12:28:46.081240 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User: tempest-VolumesNegativeTest-1224733431-project Jun 16 12:28:46.081240 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jun 16 12:28:46.081240 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jun 16 12:28:46.081240 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Id: 3c3afeab761e46569123b3a12158dcea Jun 16 12:28:46.081240 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-VolumesNegativeTest-1224733431-project Jun 16 12:28:46.081240 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: method: > Jun 16 12:28:46.081240 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: exception: Instance 2ebaa78e-5a30-4e1c-b96d-378dd8effe75 could not be found. Jun 16 12:28:46.081240 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: action_args: {'id': '2ebaa78e-5a30-4e1c-b96d-378dd8effe75'} Jun 16 12:28:46.082237 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:28:46.082237 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:28:46.082237 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:28:46.082237 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:28:46.082237 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:28:46.082237 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:28:46.082237 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:28:46.082237 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:28:46.082237 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:28:46.082237 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:28:46.082237 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ebaa78e-5a30-4e1c-b96d-378dd8effe75 could not be found. Jun 16 12:28:46.082237 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:28:46.082237 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:28:46.082237 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:28:46.082237 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:28:46.082237 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:28:46.082237 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:28:46.082237 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:28:46.082237 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:28:46.082237 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:28:46.083630 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:28:46.083630 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 12:28:46.083630 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 12:28:46.083630 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:28:46.083630 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:28:46.083630 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:28:46.083630 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:28:46.083630 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ebaa78e-5a30-4e1c-b96d-378dd8effe75 could not be found. Jun 16 12:28:46.083630 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:28:46.083630 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:28:46.083630 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:28:46.083630 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:28:46.083630 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:28:46.083630 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:28:46.083630 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:28:46.083630 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:28:46.083630 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ebaa78e-5a30-4e1c-b96d-378dd8effe75 could not be found. Jun 16 12:28:46.083630 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:28:46.084855 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1e0790bc-2a16-4934-8653-27442660984a tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] Returning 404 to user: Instance 2ebaa78e-5a30-4e1c-b96d-378dd8effe75 could not be found. {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:28:46.085554 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1e0790bc-2a16-4934-8653-27442660984a tempest-VolumesNegativeTest-1224733431 tempest-VolumesNegativeTest-1224733431-project] 10.222.0.45 "GET /compute/v2.1/servers/2ebaa78e-5a30-4e1c-b96d-378dd8effe75" status: 404 len: 111 microversion: 2.1 time: 0.049692 Jun 16 12:28:46.089105 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 144/293] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:46 2022] GET /compute/v2.1/servers/2ebaa78e-5a30-4e1c-b96d-378dd8effe75 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 12:28:46.739641 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4a8ab33a-605b-4af8-bb81-54f7b3f8f4ca tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:46.740874 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4a8ab33a-605b-4af8-bb81-54f7b3f8f4ca tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c7405152-1807-4b2a-8701-ef2b2a8cbafb] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:46.747935 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4a8ab33a-605b-4af8-bb81-54f7b3f8f4ca tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:46.748956 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4a8ab33a-605b-4af8-bb81-54f7b3f8f4ca tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:46.751187 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4a8ab33a-605b-4af8-bb81-54f7b3f8f4ca tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:46.752584 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4a8ab33a-605b-4af8-bb81-54f7b3f8f4ca tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:46.953205 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4a8ab33a-605b-4af8-bb81-54f7b3f8f4ca tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:46.965984 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4a8ab33a-605b-4af8-bb81-54f7b3f8f4ca tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb" status: 200 len: 1521 microversion: 2.1 time: 0.229459 Jun 16 12:28:46.967233 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 150/294] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:46 2022] GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:28:47.990877 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4002faf9-1bdd-4a92-a80e-b8f4417bc5d8 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:47.991689 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4002faf9-1bdd-4a92-a80e-b8f4417bc5d8 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c7405152-1807-4b2a-8701-ef2b2a8cbafb] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:48.013751 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4002faf9-1bdd-4a92-a80e-b8f4417bc5d8 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:48.014507 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4002faf9-1bdd-4a92-a80e-b8f4417bc5d8 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:48.019022 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4002faf9-1bdd-4a92-a80e-b8f4417bc5d8 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:48.023145 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4002faf9-1bdd-4a92-a80e-b8f4417bc5d8 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:48.235334 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4002faf9-1bdd-4a92-a80e-b8f4417bc5d8 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:48.244985 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4002faf9-1bdd-4a92-a80e-b8f4417bc5d8 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb" status: 200 len: 1521 microversion: 2.1 time: 0.265328 Jun 16 12:28:48.245757 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 145/295] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:47 2022] GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:28:49.263696 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4e7051a2-a933-4105-9f38-fe957be6298d tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:49.265133 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4e7051a2-a933-4105-9f38-fe957be6298d tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c7405152-1807-4b2a-8701-ef2b2a8cbafb] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:49.275965 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4e7051a2-a933-4105-9f38-fe957be6298d tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:49.277745 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4e7051a2-a933-4105-9f38-fe957be6298d tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:49.278879 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4e7051a2-a933-4105-9f38-fe957be6298d tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:49.279825 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4e7051a2-a933-4105-9f38-fe957be6298d tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:49.521950 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4e7051a2-a933-4105-9f38-fe957be6298d tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:49.531378 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4e7051a2-a933-4105-9f38-fe957be6298d tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb" status: 200 len: 1521 microversion: 2.1 time: 0.272272 Jun 16 12:28:49.543586 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 151/296] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:49 2022] GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb => generated 1521 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:28:50.550453 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-130631f8-2744-4f11-afa4-711299dc1e23 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:50.551946 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-130631f8-2744-4f11-afa4-711299dc1e23 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c7405152-1807-4b2a-8701-ef2b2a8cbafb] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:50.565229 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-130631f8-2744-4f11-afa4-711299dc1e23 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:50.566136 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-130631f8-2744-4f11-afa4-711299dc1e23 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:50.567153 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-130631f8-2744-4f11-afa4-711299dc1e23 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:50.567820 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-130631f8-2744-4f11-afa4-711299dc1e23 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:50.801600 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-130631f8-2744-4f11-afa4-711299dc1e23 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:50.811486 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-130631f8-2744-4f11-afa4-711299dc1e23 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb" status: 200 len: 1521 microversion: 2.1 time: 0.264692 Jun 16 12:28:50.814687 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 146/297] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:50 2022] GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb => generated 1521 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:28:51.837655 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5558bb7a-d7bb-4629-ac34-6b432df75b73 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:51.838577 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5558bb7a-d7bb-4629-ac34-6b432df75b73 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c7405152-1807-4b2a-8701-ef2b2a8cbafb] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:51.854820 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5558bb7a-d7bb-4629-ac34-6b432df75b73 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:51.858350 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5558bb7a-d7bb-4629-ac34-6b432df75b73 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:51.859523 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5558bb7a-d7bb-4629-ac34-6b432df75b73 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:51.861033 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5558bb7a-d7bb-4629-ac34-6b432df75b73 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:52.063650 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d78f97cc-8a26-4865-a1ae-20d110dc4938 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Action: 'create', calling method: .version_select at 0x7f7c72b3e700>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-421292343", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPNEr/jgUuqeTagPikhh1zajknn5ECW/jjUTf4/8KPhMhXmBypjaCGI5sJ2VMn6Elfm53LQyx/M8O1MV2rWzsWGPRhrAGNMaYa4tca7w3SAZ/SqQE2g3F6wNG7rJnNArgg=="}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:28:52.093161 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-d78f97cc-8a26-4865-a1ae-20d110dc4938 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Getting quotas for project 01904f10607d4b4bb91b807bff7ba8ee. Resources: {'key_pairs'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 12:28:52.097593 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-d78f97cc-8a26-4865-a1ae-20d110dc4938 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Getting quotas for user 2e645784fea14d4785df3eefabf77383 and project 01904f10607d4b4bb91b807bff7ba8ee. Resources: {'key_pairs'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 12:28:52.142088 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d78f97cc-8a26-4865-a1ae-20d110dc4938 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.083699 Jun 16 12:28:52.142897 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 147/298] 10.222.0.45 () {60 vars in 1158 bytes} [Thu Jun 16 12:28:52 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:28:52.176750 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5558bb7a-d7bb-4629-ac34-6b432df75b73 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:52.191820 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5558bb7a-d7bb-4629-ac34-6b432df75b73 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb" status: 200 len: 1521 microversion: 2.1 time: 0.359726 Jun 16 12:28:52.199490 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 152/299] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:51 2022] GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb => generated 1521 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:28:52.280363 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-abe5bae7-a78f-4a31-9652-13a1b41a26bc tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2094332472", "imageRef": "53570449-279e-4316-bdbb-34bfc29f35be", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-421292343", "networks": [{"uuid": "75dab600-336c-4dde-8026-3fe092ac2224"}]}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:28:52.336103 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.network.neutron [None req-abe5bae7-a78f-4a31-9652-13a1b41a26bc tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] validate_networks() for [('75dab600-336c-4dde-8026-3fe092ac2224', None, None, None, None, None)] {{(pid=117607) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 12:28:52.846287 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-abe5bae7-a78f-4a31-9652-13a1b41a26bc tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Flavor limits 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 12:28:52.846715 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-abe5bae7-a78f-4a31-9652-13a1b41a26bc tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Image limits 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 12:28:52.847189 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-abe5bae7-a78f-4a31-9652-13a1b41a26bc tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Flavor pref 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 12:28:52.847619 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-abe5bae7-a78f-4a31-9652-13a1b41a26bc tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Image pref 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 12:28:52.847991 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-abe5bae7-a78f-4a31-9652-13a1b41a26bc tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 12:28:52.857883 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-abe5bae7-a78f-4a31-9652-13a1b41a26bc tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:52.858353 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-abe5bae7-a78f-4a31-9652-13a1b41a26bc tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:52.859148 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-abe5bae7-a78f-4a31-9652-13a1b41a26bc tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:52.859596 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-abe5bae7-a78f-4a31-9652-13a1b41a26bc tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:52.881370 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-abe5bae7-a78f-4a31-9652-13a1b41a26bc tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Getting quotas for project 01904f10607d4b4bb91b807bff7ba8ee. Resources: {'instances', 'cores', 'ram'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 12:28:52.887431 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-abe5bae7-a78f-4a31-9652-13a1b41a26bc tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Getting quotas for user 2e645784fea14d4785df3eefabf77383 and project 01904f10607d4b4bb91b807bff7ba8ee. Resources: {'instances', 'cores', 'ram'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 12:28:52.912026 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-abe5bae7-a78f-4a31-9652-13a1b41a26bc tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Going to run 1 instances... {{(pid=117607) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 12:28:52.915245 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-abe5bae7-a78f-4a31-9652-13a1b41a26bc tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] [instance: 17f61c67-8ad3-49b1-9efa-045274e693b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='53570449-279e-4316-bdbb-34bfc29f35be',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117607) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 12:28:52.983286 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-abe5bae7-a78f-4a31-9652-13a1b41a26bc tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.709070 Jun 16 12:28:52.984238 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 148/300] 10.222.0.45 () {60 vars in 1146 bytes} [Thu Jun 16 12:28:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 711 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 12:28:52.994226 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b6e7e3c5-bee2-4bd2-8bdf-233d4fe2553a tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:52.994823 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b6e7e3c5-bee2-4bd2-8bdf-233d4fe2553a tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] [instance: 17f61c67-8ad3-49b1-9efa-045274e693b2] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:53.088500 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b6e7e3c5-bee2-4bd2-8bdf-233d4fe2553a tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e645784fea14d4785df3eefabf77383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01904f10607d4b4bb91b807bff7ba8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:53.099025 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b6e7e3c5-bee2-4bd2-8bdf-233d4fe2553a tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] 10.222.0.45 "GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2" status: 200 len: 1258 microversion: 2.1 time: 0.109174 Jun 16 12:28:53.099819 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 153/301] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:52 2022] GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2 => generated 1258 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:28:53.221526 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-906088fb-20c3-4437-a2ce-0a2f3d84680a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:53.223055 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-906088fb-20c3-4437-a2ce-0a2f3d84680a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c7405152-1807-4b2a-8701-ef2b2a8cbafb] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:53.234565 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-906088fb-20c3-4437-a2ce-0a2f3d84680a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:53.235131 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-906088fb-20c3-4437-a2ce-0a2f3d84680a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:53.235977 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-906088fb-20c3-4437-a2ce-0a2f3d84680a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:53.236490 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-906088fb-20c3-4437-a2ce-0a2f3d84680a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:53.434786 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-906088fb-20c3-4437-a2ce-0a2f3d84680a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:53.452099 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-906088fb-20c3-4437-a2ce-0a2f3d84680a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb" status: 200 len: 1501 microversion: 2.1 time: 0.243229 Jun 16 12:28:53.452675 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 149/302] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:53 2022] GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb => generated 1501 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:28:53.471326 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-393102aa-887a-442c-a7d4-2069ea23fdc4 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0cb66ed3-94b8-41be-a5e2-9abf239f70e6"}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:28:53.472472 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-393102aa-887a-442c-a7d4-2069ea23fdc4 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c7405152-1807-4b2a-8701-ef2b2a8cbafb] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:53.479063 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-393102aa-887a-442c-a7d4-2069ea23fdc4 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:53.479522 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-393102aa-887a-442c-a7d4-2069ea23fdc4 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:53.480985 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-393102aa-887a-442c-a7d4-2069ea23fdc4 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:53.481455 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-393102aa-887a-442c-a7d4-2069ea23fdc4 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:53.511154 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-393102aa-887a-442c-a7d4-2069ea23fdc4 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] HTTP exception thrown: Cannot 'attach_volume' instance c7405152-1807-4b2a-8701-ef2b2a8cbafb while it is in vm_state rescued Jun 16 12:28:53.514090 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-393102aa-887a-442c-a7d4-2069ea23fdc4 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Request method failure captured: Jun 16 12:28:53.514090 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: request: POST /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb/os-volume_attachments HTTP/1.1 Jun 16 12:28:53.514090 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 16 12:28:53.514090 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 16 12:28:53.514090 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Connection: close Jun 16 12:28:53.514090 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Content-Length: 74 Jun 16 12:28:53.514090 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 16 12:28:53.514090 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Host: 10.222.0.45 Jun 16 12:28:53.514090 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 16 12:28:53.514090 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 16 12:28:53.514090 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABiqyGES1jPC9zoTp2cmyHjjCfKzUThVvFVDddjyKIwirFIWtW3ZvKtdRT79lGPcaFE642K8AID4DI8GVJJbegi6HvqkNpIy3K9U8GXQ6HrKIxQ5j39hAm1F4SXapv5IvLs7SJL9UbGXGXJJIr0wozEivmIxAYUgMQ3ylzJESix1mP4Yww Jun 16 12:28:53.514090 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 16 12:28:53.514090 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 16 12:28:53.514090 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 16 12:28:53.514090 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 16 12:28:53.514090 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 16 12:28:53.514090 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 16 12:28:53.514090 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Id: 338412f496e246eebc934f348c539335 Jun 16 12:28:53.514090 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-755756367 Jun 16 12:28:53.514090 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 16 12:28:53.514090 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 16 12:28:53.516006 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/338412f496e246eebc934f348c539335"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/338412f496e246eebc934f348c539335"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_338412f496e246eebc934f348c539335"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/338412f496e246eebc934f348c539335"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Jun 16 12:28:53.516006 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-ServerRescueNegativeTestJSON-755756367 Jun 16 12:28:53.516006 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 338412f496e246eebc934f348c539335 Jun 16 12:28:53.516006 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-755756367 Jun 16 12:28:53.516006 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User: tempest-ServerRescueNegativeTestJSON-755756367-project Jun 16 12:28:53.516006 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 16 12:28:53.516006 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 16 12:28:53.516006 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Id: a333ad2fb1c74ef9a666aa591616d7a2 Jun 16 12:28:53.516006 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-ServerRescueNegativeTestJSON-755756367-project Jun 16 12:28:53.516006 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Jun 16 12:28:53.516006 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: {"volumeAttachment": {"volumeId": "0cb66ed3-94b8-41be-a5e2-9abf239f70e6"}} Jun 16 12:28:53.516006 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: method: > Jun 16 12:28:53.521340 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: exception: Cannot 'attach_volume' instance c7405152-1807-4b2a-8701-ef2b2a8cbafb while it is in vm_state rescued Jun 16 12:28:53.521340 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: action_args: {'server_id': 'c7405152-1807-4b2a-8701-ef2b2a8cbafb', 'body': {'volumeAttachment': {'volumeId': '0cb66ed3-94b8-41be-a5e2-9abf239f70e6'}}} Jun 16 12:28:53.521340 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:28:53.521340 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:28:53.521340 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 16 12:28:53.521340 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 16 12:28:53.521340 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 12:28:53.521340 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 12:28:53.521340 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 16 12:28:53.521340 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 16 12:28:53.521340 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c7405152-1807-4b2a-8701-ef2b2a8cbafb in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 16 12:28:53.521340 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:28:53.521340 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:28:53.521340 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:28:53.521340 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:28:53.521340 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:28:53.521340 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:28:53.521340 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:28:53.521340 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:28:53.522679 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:28:53.522679 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:28:53.522679 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 12:28:53.522679 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 12:28:53.522679 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 12:28:53.522679 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 12:28:53.522679 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 12:28:53.522679 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 12:28:53.522679 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 16 12:28:53.522679 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 16 12:28:53.522679 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 16 12:28:53.522679 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 16 12:28:53.522679 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance c7405152-1807-4b2a-8701-ef2b2a8cbafb while it is in vm_state rescued Jun 16 12:28:53.522679 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:28:53.522679 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:28:53.522679 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:28:53.522679 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:28:53.522679 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:28:53.522679 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:28:53.526289 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:28:53.526289 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:28:53.526289 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance c7405152-1807-4b2a-8701-ef2b2a8cbafb while it is in vm_state rescued Jun 16 12:28:53.526289 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:28:53.526289 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-393102aa-887a-442c-a7d4-2069ea23fdc4 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Returning 409 to user: Cannot 'attach_volume' instance c7405152-1807-4b2a-8701-ef2b2a8cbafb while it is in vm_state rescued {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:28:53.526289 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-393102aa-887a-442c-a7d4-2069ea23fdc4 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "POST /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.048233 Jun 16 12:28:53.526289 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 154/303] 10.222.0.45 () {60 vars in 1322 bytes} [Thu Jun 16 12:28:53 2022] POST /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb/os-volume_attachments => generated 152 bytes in 50 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 16 12:28:53.532589 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c23b7892-1ad3-4185-8371-d02e3813b7d5 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:28:53.533161 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c23b7892-1ad3-4185-8371-d02e3813b7d5 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c7405152-1807-4b2a-8701-ef2b2a8cbafb] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:53.539773 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c23b7892-1ad3-4185-8371-d02e3813b7d5 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:53.540229 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c23b7892-1ad3-4185-8371-d02e3813b7d5 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:53.541915 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c23b7892-1ad3-4185-8371-d02e3813b7d5 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:53.543481 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c23b7892-1ad3-4185-8371-d02e3813b7d5 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:53.643153 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c23b7892-1ad3-4185-8371-d02e3813b7d5 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "POST /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb/action" status: 202 len: 0 microversion: 2.1 time: 0.120098 Jun 16 12:28:53.644335 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 150/304] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Jun 16 12:28:53 2022] POST /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 12:28:53.652965 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-12538bee-a74b-4878-ba22-07a5b88cee62 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:53.653586 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-12538bee-a74b-4878-ba22-07a5b88cee62 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c7405152-1807-4b2a-8701-ef2b2a8cbafb] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:53.662584 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-12538bee-a74b-4878-ba22-07a5b88cee62 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:53.663038 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-12538bee-a74b-4878-ba22-07a5b88cee62 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:53.663816 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-12538bee-a74b-4878-ba22-07a5b88cee62 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:53.665430 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-12538bee-a74b-4878-ba22-07a5b88cee62 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:53.929155 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-12538bee-a74b-4878-ba22-07a5b88cee62 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:53.939380 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-12538bee-a74b-4878-ba22-07a5b88cee62 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb" status: 200 len: 1509 microversion: 2.1 time: 0.290700 Jun 16 12:28:53.939952 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 155/305] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:53 2022] GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb => generated 1509 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:28:54.117110 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c44a3f52-e3bd-4507-9207-a0c8f0c1ea26 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:54.117812 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c44a3f52-e3bd-4507-9207-a0c8f0c1ea26 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] [instance: 17f61c67-8ad3-49b1-9efa-045274e693b2] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:54.133559 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c44a3f52-e3bd-4507-9207-a0c8f0c1ea26 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:54.134126 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c44a3f52-e3bd-4507-9207-a0c8f0c1ea26 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:54.134922 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c44a3f52-e3bd-4507-9207-a0c8f0c1ea26 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:54.135359 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c44a3f52-e3bd-4507-9207-a0c8f0c1ea26 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:54.241187 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c44a3f52-e3bd-4507-9207-a0c8f0c1ea26 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e645784fea14d4785df3eefabf77383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01904f10607d4b4bb91b807bff7ba8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:54.255279 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c44a3f52-e3bd-4507-9207-a0c8f0c1ea26 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] 10.222.0.45 "GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2" status: 200 len: 1310 microversion: 2.1 time: 0.142382 Jun 16 12:28:54.259980 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 151/306] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:54 2022] GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2 => generated 1310 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:28:54.969819 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6ddde5f9-b21a-4afe-957f-993ad9fac2f3 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:54.971629 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6ddde5f9-b21a-4afe-957f-993ad9fac2f3 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c7405152-1807-4b2a-8701-ef2b2a8cbafb] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:54.990823 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6ddde5f9-b21a-4afe-957f-993ad9fac2f3 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:54.992652 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6ddde5f9-b21a-4afe-957f-993ad9fac2f3 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:54.993720 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6ddde5f9-b21a-4afe-957f-993ad9fac2f3 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:54.996611 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6ddde5f9-b21a-4afe-957f-993ad9fac2f3 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:55.286151 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-614c1729-de83-4f5b-9ade-0cc3ed7e55e2 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:55.286776 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-614c1729-de83-4f5b-9ade-0cc3ed7e55e2 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] [instance: 17f61c67-8ad3-49b1-9efa-045274e693b2] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:55.301704 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-614c1729-de83-4f5b-9ade-0cc3ed7e55e2 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:55.302797 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-614c1729-de83-4f5b-9ade-0cc3ed7e55e2 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:55.304044 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-614c1729-de83-4f5b-9ade-0cc3ed7e55e2 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:55.304983 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-614c1729-de83-4f5b-9ade-0cc3ed7e55e2 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:55.405634 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6ddde5f9-b21a-4afe-957f-993ad9fac2f3 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:55.413663 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6ddde5f9-b21a-4afe-957f-993ad9fac2f3 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb" status: 200 len: 1509 microversion: 2.1 time: 0.460855 Jun 16 12:28:55.436779 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 156/307] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:54 2022] GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb => generated 1509 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:28:55.453048 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-614c1729-de83-4f5b-9ade-0cc3ed7e55e2 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e645784fea14d4785df3eefabf77383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01904f10607d4b4bb91b807bff7ba8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:55.466600 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-614c1729-de83-4f5b-9ade-0cc3ed7e55e2 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] 10.222.0.45 "GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2" status: 200 len: 1316 microversion: 2.1 time: 0.189572 Jun 16 12:28:55.477732 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 152/308] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:55 2022] GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2 => generated 1316 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:28:56.443161 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-dc975154-aa23-42b2-81fb-0f62816eba9c tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:56.443767 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-dc975154-aa23-42b2-81fb-0f62816eba9c tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c7405152-1807-4b2a-8701-ef2b2a8cbafb] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:56.450877 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dc975154-aa23-42b2-81fb-0f62816eba9c tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:56.451371 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dc975154-aa23-42b2-81fb-0f62816eba9c tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:56.452226 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dc975154-aa23-42b2-81fb-0f62816eba9c tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:56.452572 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dc975154-aa23-42b2-81fb-0f62816eba9c tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:56.485584 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-aa5fb1f3-ce19-483a-a7e1-22618cfddef9 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:56.486254 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-aa5fb1f3-ce19-483a-a7e1-22618cfddef9 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] [instance: 17f61c67-8ad3-49b1-9efa-045274e693b2] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:56.499285 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-aa5fb1f3-ce19-483a-a7e1-22618cfddef9 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:56.499734 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-aa5fb1f3-ce19-483a-a7e1-22618cfddef9 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:56.500661 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-aa5fb1f3-ce19-483a-a7e1-22618cfddef9 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:56.501162 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-aa5fb1f3-ce19-483a-a7e1-22618cfddef9 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:56.703413 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-dc975154-aa23-42b2-81fb-0f62816eba9c tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:56.710500 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-aa5fb1f3-ce19-483a-a7e1-22618cfddef9 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e645784fea14d4785df3eefabf77383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01904f10607d4b4bb91b807bff7ba8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:56.711892 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-dc975154-aa23-42b2-81fb-0f62816eba9c tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb" status: 200 len: 1509 microversion: 2.1 time: 0.272048 Jun 16 12:28:56.712627 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 157/309] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:56 2022] GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb => generated 1509 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:28:56.729666 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-aa5fb1f3-ce19-483a-a7e1-22618cfddef9 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] 10.222.0.45 "GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2" status: 200 len: 1358 microversion: 2.1 time: 0.249477 Jun 16 12:28:56.730882 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 153/310] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:56 2022] GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2 => generated 1358 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:28:57.732715 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b92d3691-e073-4a2e-bb9b-7e06d708250a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:57.733732 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b92d3691-e073-4a2e-bb9b-7e06d708250a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c7405152-1807-4b2a-8701-ef2b2a8cbafb] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:57.754748 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ed898012-538b-46e8-a1ef-3bd6132f8c28 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:57.756933 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ed898012-538b-46e8-a1ef-3bd6132f8c28 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] [instance: 17f61c67-8ad3-49b1-9efa-045274e693b2] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:57.765525 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b92d3691-e073-4a2e-bb9b-7e06d708250a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:57.767479 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b92d3691-e073-4a2e-bb9b-7e06d708250a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:57.770001 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b92d3691-e073-4a2e-bb9b-7e06d708250a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:57.771190 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b92d3691-e073-4a2e-bb9b-7e06d708250a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:57.781777 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ed898012-538b-46e8-a1ef-3bd6132f8c28 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:57.783026 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ed898012-538b-46e8-a1ef-3bd6132f8c28 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:57.783340 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ed898012-538b-46e8-a1ef-3bd6132f8c28 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:57.784060 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ed898012-538b-46e8-a1ef-3bd6132f8c28 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:58.174138 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b92d3691-e073-4a2e-bb9b-7e06d708250a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:58.178191 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ed898012-538b-46e8-a1ef-3bd6132f8c28 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e645784fea14d4785df3eefabf77383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01904f10607d4b4bb91b807bff7ba8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:58.182407 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b92d3691-e073-4a2e-bb9b-7e06d708250a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb" status: 200 len: 1509 microversion: 2.1 time: 0.455524 Jun 16 12:28:58.187769 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 158/311] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:57 2022] GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb => generated 1509 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:28:58.188950 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ed898012-538b-46e8-a1ef-3bd6132f8c28 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] 10.222.0.45 "GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2" status: 200 len: 1358 microversion: 2.1 time: 0.438005 Jun 16 12:28:58.189526 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 154/312] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:57 2022] GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2 => generated 1358 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:28:59.207322 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-bb20c0c7-32fb-46ce-a09c-9b13a6106ea0 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:59.207893 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-10350b78-1310-440a-8ca3-bc8988b17463 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:28:59.208288 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-bb20c0c7-32fb-46ce-a09c-9b13a6106ea0 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c7405152-1807-4b2a-8701-ef2b2a8cbafb] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:59.208393 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-10350b78-1310-440a-8ca3-bc8988b17463 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] [instance: 17f61c67-8ad3-49b1-9efa-045274e693b2] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:28:59.216159 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bb20c0c7-32fb-46ce-a09c-9b13a6106ea0 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:59.216894 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bb20c0c7-32fb-46ce-a09c-9b13a6106ea0 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:59.218119 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bb20c0c7-32fb-46ce-a09c-9b13a6106ea0 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:59.218846 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bb20c0c7-32fb-46ce-a09c-9b13a6106ea0 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:59.218966 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-10350b78-1310-440a-8ca3-bc8988b17463 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:59.219437 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-10350b78-1310-440a-8ca3-bc8988b17463 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:59.220208 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-10350b78-1310-440a-8ca3-bc8988b17463 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:28:59.220754 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-10350b78-1310-440a-8ca3-bc8988b17463 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:28:59.224488 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:28:59.473448 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-10350b78-1310-440a-8ca3-bc8988b17463 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e645784fea14d4785df3eefabf77383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01904f10607d4b4bb91b807bff7ba8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:59.482217 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-10350b78-1310-440a-8ca3-bc8988b17463 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] 10.222.0.45 "GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2" status: 200 len: 1358 microversion: 2.1 time: 0.279257 Jun 16 12:28:59.483071 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 155/313] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:59 2022] GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2 => generated 1358 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:28:59.501519 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-bb20c0c7-32fb-46ce-a09c-9b13a6106ea0 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:28:59.510486 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-bb20c0c7-32fb-46ce-a09c-9b13a6106ea0 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb" status: 200 len: 1509 microversion: 2.1 time: 0.307609 Jun 16 12:28:59.511979 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 159/314] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:28:59 2022] GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb => generated 1509 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:29:00.505084 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7e039995-441a-48e4-b27b-840abe087878 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:00.506395 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7e039995-441a-48e4-b27b-840abe087878 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] [instance: 17f61c67-8ad3-49b1-9efa-045274e693b2] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:00.513729 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7e039995-441a-48e4-b27b-840abe087878 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:00.514210 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7e039995-441a-48e4-b27b-840abe087878 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:00.515033 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7e039995-441a-48e4-b27b-840abe087878 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:00.515418 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7e039995-441a-48e4-b27b-840abe087878 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:00.529301 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b6fdd015-242d-4d5b-9aba-b56b775274cf tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:00.530096 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b6fdd015-242d-4d5b-9aba-b56b775274cf tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c7405152-1807-4b2a-8701-ef2b2a8cbafb] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:00.537698 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b6fdd015-242d-4d5b-9aba-b56b775274cf tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:00.538259 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b6fdd015-242d-4d5b-9aba-b56b775274cf tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:00.539085 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b6fdd015-242d-4d5b-9aba-b56b775274cf tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:00.539583 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b6fdd015-242d-4d5b-9aba-b56b775274cf tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:00.559089 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:29:00.744502 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7e039995-441a-48e4-b27b-840abe087878 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e645784fea14d4785df3eefabf77383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01904f10607d4b4bb91b807bff7ba8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:00.748773 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b6fdd015-242d-4d5b-9aba-b56b775274cf tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:00.753639 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7e039995-441a-48e4-b27b-840abe087878 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] 10.222.0.45 "GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2" status: 200 len: 1358 microversion: 2.1 time: 0.252699 Jun 16 12:29:00.754253 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 156/315] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:00 2022] GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2 => generated 1358 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:29:00.758900 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-121021e4-55f2-481f-b42d-f68f0d72c0a0 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1601646974", "imageRef": "c736a2d2-9d0d-41ec-b9fc-971428b0ff7a", "flavorRef": "452", "networks": [{"uuid": "a714d974-7de3-44a6-a856-0298637e4d4a"}]}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:29:00.759092 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b6fdd015-242d-4d5b-9aba-b56b775274cf tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb" status: 200 len: 1509 microversion: 2.1 time: 0.234236 Jun 16 12:29:00.759877 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 160/316] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:00 2022] GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb => generated 1509 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:29:00.812103 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.network.neutron [None req-121021e4-55f2-481f-b42d-f68f0d72c0a0 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] validate_networks() for [('a714d974-7de3-44a6-a856-0298637e4d4a', None, None, None, None, None)] {{(pid=117607) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 12:29:01.189670 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-121021e4-55f2-481f-b42d-f68f0d72c0a0 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Flavor limits 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 12:29:01.190124 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-121021e4-55f2-481f-b42d-f68f0d72c0a0 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Image limits 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 12:29:01.190635 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-121021e4-55f2-481f-b42d-f68f0d72c0a0 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Flavor pref 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 12:29:01.191331 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-121021e4-55f2-481f-b42d-f68f0d72c0a0 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Image pref 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 12:29:01.191747 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-121021e4-55f2-481f-b42d-f68f0d72c0a0 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 12:29:01.204510 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-121021e4-55f2-481f-b42d-f68f0d72c0a0 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:01.205009 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-121021e4-55f2-481f-b42d-f68f0d72c0a0 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:01.205890 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-121021e4-55f2-481f-b42d-f68f0d72c0a0 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:01.206342 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-121021e4-55f2-481f-b42d-f68f0d72c0a0 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:01.224965 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-121021e4-55f2-481f-b42d-f68f0d72c0a0 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Getting quotas for project b09e491f80c24a2691e396df0175a057. Resources: {'instances', 'cores', 'ram'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 12:29:01.229146 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-121021e4-55f2-481f-b42d-f68f0d72c0a0 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Getting quotas for user b5f451e0f5c945d8ade3c2a4ea3398c2 and project b09e491f80c24a2691e396df0175a057. Resources: {'instances', 'cores', 'ram'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 12:29:01.241786 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-121021e4-55f2-481f-b42d-f68f0d72c0a0 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Going to run 1 instances... {{(pid=117607) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 12:29:01.244092 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-121021e4-55f2-481f-b42d-f68f0d72c0a0 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] [instance: c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c736a2d2-9d0d-41ec-b9fc-971428b0ff7a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117607) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 12:29:01.289284 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-121021e4-55f2-481f-b42d-f68f0d72c0a0 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.533673 Jun 16 12:29:01.289957 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 157/317] 10.222.0.45 () {60 vars in 1146 bytes} [Thu Jun 16 12:29:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 12:29:01.302732 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-62eaa485-b1d0-4a25-b41c-5c6df010ab0a tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:01.303857 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-62eaa485-b1d0-4a25-b41c-5c6df010ab0a tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] [instance: c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:01.389983 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-62eaa485-b1d0-4a25-b41c-5c6df010ab0a tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f451e0f5c945d8ade3c2a4ea3398c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09e491f80c24a2691e396df0175a057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:01.399327 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-62eaa485-b1d0-4a25-b41c-5c6df010ab0a tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] 10.222.0.45 "GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33" status: 200 len: 1219 microversion: 2.1 time: 0.102895 Jun 16 12:29:01.400330 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 161/318] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:01 2022] GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33 => generated 1219 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:29:01.770551 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7230b7d4-9241-41df-b01a-64c6a57f3df3 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:01.772343 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7230b7d4-9241-41df-b01a-64c6a57f3df3 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] [instance: 17f61c67-8ad3-49b1-9efa-045274e693b2] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:01.776772 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8a54c689-4063-4d4e-a296-53df99c6d3a4 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:01.777390 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8a54c689-4063-4d4e-a296-53df99c6d3a4 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c7405152-1807-4b2a-8701-ef2b2a8cbafb] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:01.781925 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7230b7d4-9241-41df-b01a-64c6a57f3df3 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:01.782596 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7230b7d4-9241-41df-b01a-64c6a57f3df3 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:01.783321 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7230b7d4-9241-41df-b01a-64c6a57f3df3 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:01.783478 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8a54c689-4063-4d4e-a296-53df99c6d3a4 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:01.783925 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7230b7d4-9241-41df-b01a-64c6a57f3df3 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:01.784313 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8a54c689-4063-4d4e-a296-53df99c6d3a4 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:01.785340 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8a54c689-4063-4d4e-a296-53df99c6d3a4 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:01.785775 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8a54c689-4063-4d4e-a296-53df99c6d3a4 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:02.014754 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8a54c689-4063-4d4e-a296-53df99c6d3a4 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:02.022466 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8a54c689-4063-4d4e-a296-53df99c6d3a4 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb" status: 200 len: 1509 microversion: 2.1 time: 0.249951 Jun 16 12:29:02.023175 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 162/319] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:01 2022] GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb => generated 1509 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:29:02.027586 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7230b7d4-9241-41df-b01a-64c6a57f3df3 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e645784fea14d4785df3eefabf77383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01904f10607d4b4bb91b807bff7ba8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:02.035154 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7230b7d4-9241-41df-b01a-64c6a57f3df3 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] 10.222.0.45 "GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2" status: 200 len: 1358 microversion: 2.1 time: 0.268857 Jun 16 12:29:02.035703 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 158/320] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:01 2022] GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2 => generated 1358 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:29:02.417894 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7c9ae06c-10c0-4af4-bdc9-3f66efe703ad tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:02.418538 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7c9ae06c-10c0-4af4-bdc9-3f66efe703ad tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] [instance: c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:02.425032 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7c9ae06c-10c0-4af4-bdc9-3f66efe703ad tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:02.425477 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7c9ae06c-10c0-4af4-bdc9-3f66efe703ad tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:02.426265 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7c9ae06c-10c0-4af4-bdc9-3f66efe703ad tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:02.426697 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7c9ae06c-10c0-4af4-bdc9-3f66efe703ad tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:02.491541 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7c9ae06c-10c0-4af4-bdc9-3f66efe703ad tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f451e0f5c945d8ade3c2a4ea3398c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09e491f80c24a2691e396df0175a057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:02.503952 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7c9ae06c-10c0-4af4-bdc9-3f66efe703ad tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] 10.222.0.45 "GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33" status: 200 len: 1223 microversion: 2.1 time: 0.089916 Jun 16 12:29:02.513772 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 163/321] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:02 2022] GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33 => generated 1223 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:29:03.040963 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f684b0d3-82e6-4be9-a786-f4289b617e6f tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:03.041402 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f684b0d3-82e6-4be9-a786-f4289b617e6f tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c7405152-1807-4b2a-8701-ef2b2a8cbafb] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:03.049949 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f684b0d3-82e6-4be9-a786-f4289b617e6f tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:03.050675 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f684b0d3-82e6-4be9-a786-f4289b617e6f tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:03.051695 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f684b0d3-82e6-4be9-a786-f4289b617e6f tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:03.052365 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9d34182f-bda9-47ee-b3b0-0a09f049da31 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:03.052977 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9d34182f-bda9-47ee-b3b0-0a09f049da31 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] [instance: 17f61c67-8ad3-49b1-9efa-045274e693b2] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:03.053383 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f684b0d3-82e6-4be9-a786-f4289b617e6f tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:03.063701 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9d34182f-bda9-47ee-b3b0-0a09f049da31 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:03.064183 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9d34182f-bda9-47ee-b3b0-0a09f049da31 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:03.064940 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9d34182f-bda9-47ee-b3b0-0a09f049da31 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:03.065362 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9d34182f-bda9-47ee-b3b0-0a09f049da31 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:03.523975 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9d34182f-bda9-47ee-b3b0-0a09f049da31 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e645784fea14d4785df3eefabf77383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01904f10607d4b4bb91b807bff7ba8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:03.526683 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f684b0d3-82e6-4be9-a786-f4289b617e6f tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:03.531800 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9d34182f-bda9-47ee-b3b0-0a09f049da31 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] 10.222.0.45 "GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2" status: 200 len: 1358 microversion: 2.1 time: 0.483359 Jun 16 12:29:03.538306 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f684b0d3-82e6-4be9-a786-f4289b617e6f tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb" status: 200 len: 1509 microversion: 2.1 time: 0.501417 Jun 16 12:29:03.538877 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 159/322] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:03 2022] GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb => generated 1509 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:29:03.541732 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 164/323] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:03 2022] GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2 => generated 1358 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:29:03.548999 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-184c2f92-0d37-4dd5-afaf-ef033365b021 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:03.549609 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-184c2f92-0d37-4dd5-afaf-ef033365b021 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] [instance: c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:03.555605 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-184c2f92-0d37-4dd5-afaf-ef033365b021 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:03.556052 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-184c2f92-0d37-4dd5-afaf-ef033365b021 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:03.556807 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-184c2f92-0d37-4dd5-afaf-ef033365b021 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:03.557241 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-184c2f92-0d37-4dd5-afaf-ef033365b021 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:03.619422 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-184c2f92-0d37-4dd5-afaf-ef033365b021 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f451e0f5c945d8ade3c2a4ea3398c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09e491f80c24a2691e396df0175a057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:03.628137 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-184c2f92-0d37-4dd5-afaf-ef033365b021 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] 10.222.0.45 "GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33" status: 200 len: 1223 microversion: 2.1 time: 0.088222 Jun 16 12:29:03.629340 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 160/324] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:03 2022] GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33 => generated 1223 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:29:04.548974 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d678c5ea-f7b5-4285-8373-c9b9a0cda774 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:04.549640 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d678c5ea-f7b5-4285-8373-c9b9a0cda774 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] [instance: 17f61c67-8ad3-49b1-9efa-045274e693b2] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:04.555422 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-68248a3b-e0c6-4a77-a499-abae47f77829 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:04.555893 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d678c5ea-f7b5-4285-8373-c9b9a0cda774 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:04.556047 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-68248a3b-e0c6-4a77-a499-abae47f77829 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c7405152-1807-4b2a-8701-ef2b2a8cbafb] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:04.556269 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d678c5ea-f7b5-4285-8373-c9b9a0cda774 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:04.557029 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d678c5ea-f7b5-4285-8373-c9b9a0cda774 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:04.557473 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d678c5ea-f7b5-4285-8373-c9b9a0cda774 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:04.562789 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-68248a3b-e0c6-4a77-a499-abae47f77829 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:04.563241 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-68248a3b-e0c6-4a77-a499-abae47f77829 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:04.564006 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-68248a3b-e0c6-4a77-a499-abae47f77829 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:04.564442 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-68248a3b-e0c6-4a77-a499-abae47f77829 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:04.769477 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d678c5ea-f7b5-4285-8373-c9b9a0cda774 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e645784fea14d4785df3eefabf77383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01904f10607d4b4bb91b807bff7ba8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:04.777543 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d678c5ea-f7b5-4285-8373-c9b9a0cda774 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] 10.222.0.45 "GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2" status: 200 len: 1358 microversion: 2.1 time: 0.232431 Jun 16 12:29:04.778148 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 165/325] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:04 2022] GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2 => generated 1358 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:29:04.782662 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b8e1f85a-4f1d-4d11-8f7a-73f3fce3513c tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:04.783478 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b8e1f85a-4f1d-4d11-8f7a-73f3fce3513c tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] [instance: c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:04.789550 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b8e1f85a-4f1d-4d11-8f7a-73f3fce3513c tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:04.790107 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b8e1f85a-4f1d-4d11-8f7a-73f3fce3513c tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:04.790793 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b8e1f85a-4f1d-4d11-8f7a-73f3fce3513c tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:04.791237 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b8e1f85a-4f1d-4d11-8f7a-73f3fce3513c tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:04.792961 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-68248a3b-e0c6-4a77-a499-abae47f77829 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:04.800167 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-68248a3b-e0c6-4a77-a499-abae47f77829 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb" status: 200 len: 1509 microversion: 2.1 time: 0.248494 Jun 16 12:29:04.800852 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 161/326] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:04 2022] GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb => generated 1509 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:29:04.876770 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b8e1f85a-4f1d-4d11-8f7a-73f3fce3513c tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f451e0f5c945d8ade3c2a4ea3398c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09e491f80c24a2691e396df0175a057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:04.884601 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b8e1f85a-4f1d-4d11-8f7a-73f3fce3513c tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] 10.222.0.45 "GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33" status: 200 len: 1223 microversion: 2.1 time: 0.105356 Jun 16 12:29:04.885171 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 166/327] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:04 2022] GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33 => generated 1223 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:29:05.794298 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6587ee1d-1acf-4f69-aec6-e89fd2eca45a tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:05.794976 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6587ee1d-1acf-4f69-aec6-e89fd2eca45a tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] [instance: 17f61c67-8ad3-49b1-9efa-045274e693b2] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:05.801349 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6587ee1d-1acf-4f69-aec6-e89fd2eca45a tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:05.801797 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6587ee1d-1acf-4f69-aec6-e89fd2eca45a tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:05.802604 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6587ee1d-1acf-4f69-aec6-e89fd2eca45a tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:05.803049 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6587ee1d-1acf-4f69-aec6-e89fd2eca45a tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:05.821704 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-25dca7e9-3ed5-4446-aa1b-261c144c057c tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:05.823015 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-25dca7e9-3ed5-4446-aa1b-261c144c057c tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c7405152-1807-4b2a-8701-ef2b2a8cbafb] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:05.830255 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-25dca7e9-3ed5-4446-aa1b-261c144c057c tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:05.830725 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-25dca7e9-3ed5-4446-aa1b-261c144c057c tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:05.831524 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-25dca7e9-3ed5-4446-aa1b-261c144c057c tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:05.832022 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-25dca7e9-3ed5-4446-aa1b-261c144c057c tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:05.991041 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6587ee1d-1acf-4f69-aec6-e89fd2eca45a tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e645784fea14d4785df3eefabf77383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01904f10607d4b4bb91b807bff7ba8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:05.998478 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6587ee1d-1acf-4f69-aec6-e89fd2eca45a tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] 10.222.0.45 "GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2" status: 200 len: 1358 microversion: 2.1 time: 0.208234 Jun 16 12:29:05.999041 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 162/328] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:05 2022] GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2 => generated 1358 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:29:06.007174 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-cb22c2d4-7647-4853-81ed-cd2d2349e728 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:06.008023 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-cb22c2d4-7647-4853-81ed-cd2d2349e728 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] [instance: c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:06.015697 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cb22c2d4-7647-4853-81ed-cd2d2349e728 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:06.016148 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cb22c2d4-7647-4853-81ed-cd2d2349e728 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:06.016760 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-25dca7e9-3ed5-4446-aa1b-261c144c057c tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:06.016945 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cb22c2d4-7647-4853-81ed-cd2d2349e728 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:06.017375 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cb22c2d4-7647-4853-81ed-cd2d2349e728 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:06.024164 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-25dca7e9-3ed5-4446-aa1b-261c144c057c tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb" status: 200 len: 1509 microversion: 2.1 time: 0.210287 Jun 16 12:29:06.024722 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 167/329] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:05 2022] GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb => generated 1509 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:29:06.079411 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-cb22c2d4-7647-4853-81ed-cd2d2349e728 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f451e0f5c945d8ade3c2a4ea3398c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09e491f80c24a2691e396df0175a057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:06.087107 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-cb22c2d4-7647-4853-81ed-cd2d2349e728 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] 10.222.0.45 "GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33" status: 200 len: 1223 microversion: 2.1 time: 0.087139 Jun 16 12:29:06.087655 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 163/330] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:05 2022] GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33 => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:29:07.016178 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-48586a39-5bec-412d-8ed2-f76644e4cfa5 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:07.016827 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-48586a39-5bec-412d-8ed2-f76644e4cfa5 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] [instance: 17f61c67-8ad3-49b1-9efa-045274e693b2] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:07.022887 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-48586a39-5bec-412d-8ed2-f76644e4cfa5 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:07.023353 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-48586a39-5bec-412d-8ed2-f76644e4cfa5 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:07.024117 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-48586a39-5bec-412d-8ed2-f76644e4cfa5 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:07.024557 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-48586a39-5bec-412d-8ed2-f76644e4cfa5 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:07.043258 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8e2bd32d-8ed7-46b8-9de1-28e14d216da1 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:07.043875 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8e2bd32d-8ed7-46b8-9de1-28e14d216da1 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c7405152-1807-4b2a-8701-ef2b2a8cbafb] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:07.046220 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:29:07.052284 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8e2bd32d-8ed7-46b8-9de1-28e14d216da1 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:07.052777 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8e2bd32d-8ed7-46b8-9de1-28e14d216da1 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:07.053542 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8e2bd32d-8ed7-46b8-9de1-28e14d216da1 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:07.054075 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8e2bd32d-8ed7-46b8-9de1-28e14d216da1 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:07.254676 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-48586a39-5bec-412d-8ed2-f76644e4cfa5 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e645784fea14d4785df3eefabf77383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01904f10607d4b4bb91b807bff7ba8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:07.268550 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-48586a39-5bec-412d-8ed2-f76644e4cfa5 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] 10.222.0.45 "GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2" status: 200 len: 1358 microversion: 2.1 time: 0.255810 Jun 16 12:29:07.280112 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8e2bd32d-8ed7-46b8-9de1-28e14d216da1 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:07.280804 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 168/331] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:07 2022] GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2 => generated 1358 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:29:07.280804 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-caf63e9e-f302-4d3d-8fa1-2156e41666ba tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:07.280964 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-caf63e9e-f302-4d3d-8fa1-2156e41666ba tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] [instance: c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:07.288372 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8e2bd32d-8ed7-46b8-9de1-28e14d216da1 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb" status: 200 len: 1509 microversion: 2.1 time: 0.248448 Jun 16 12:29:07.289204 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 164/332] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:07 2022] GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb => generated 1509 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:29:07.291348 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-caf63e9e-f302-4d3d-8fa1-2156e41666ba tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:07.292123 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-caf63e9e-f302-4d3d-8fa1-2156e41666ba tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:07.293382 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-caf63e9e-f302-4d3d-8fa1-2156e41666ba tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:07.294151 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-caf63e9e-f302-4d3d-8fa1-2156e41666ba tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:07.377223 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-caf63e9e-f302-4d3d-8fa1-2156e41666ba tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f451e0f5c945d8ade3c2a4ea3398c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09e491f80c24a2691e396df0175a057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:07.386380 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-caf63e9e-f302-4d3d-8fa1-2156e41666ba tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] 10.222.0.45 "GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33" status: 200 len: 1223 microversion: 2.1 time: 0.114484 Jun 16 12:29:07.387028 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 169/333] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:07 2022] GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33 => generated 1223 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:29:08.288131 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-671d067a-0660-41a9-bdd7-fded09f39bbf tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:08.288662 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-671d067a-0660-41a9-bdd7-fded09f39bbf tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] [instance: 17f61c67-8ad3-49b1-9efa-045274e693b2] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:08.295343 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-671d067a-0660-41a9-bdd7-fded09f39bbf tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:08.295784 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-671d067a-0660-41a9-bdd7-fded09f39bbf tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:08.296526 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-671d067a-0660-41a9-bdd7-fded09f39bbf tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:08.296954 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-671d067a-0660-41a9-bdd7-fded09f39bbf tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:08.305534 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c7d87336-335d-4034-8963-36387b87df61 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:08.306200 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c7d87336-335d-4034-8963-36387b87df61 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c7405152-1807-4b2a-8701-ef2b2a8cbafb] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:08.312720 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c7d87336-335d-4034-8963-36387b87df61 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:08.313170 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c7d87336-335d-4034-8963-36387b87df61 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:08.313962 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c7d87336-335d-4034-8963-36387b87df61 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:08.314399 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c7d87336-335d-4034-8963-36387b87df61 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:08.499193 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-671d067a-0660-41a9-bdd7-fded09f39bbf tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e645784fea14d4785df3eefabf77383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01904f10607d4b4bb91b807bff7ba8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:08.502445 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c7d87336-335d-4034-8963-36387b87df61 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:08.506667 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-671d067a-0660-41a9-bdd7-fded09f39bbf tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] 10.222.0.45 "GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2" status: 200 len: 1358 microversion: 2.1 time: 0.222667 Jun 16 12:29:08.507259 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 165/334] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:08 2022] GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2 => generated 1358 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:29:08.510069 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c7d87336-335d-4034-8963-36387b87df61 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb" status: 200 len: 1509 microversion: 2.1 time: 0.208237 Jun 16 12:29:08.510889 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 170/335] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:08 2022] GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb => generated 1509 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:29:08.512178 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a2826a0b-2eba-4af8-be01-7aed09921e1c tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:08.512968 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a2826a0b-2eba-4af8-be01-7aed09921e1c tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] [instance: c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:08.518767 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a2826a0b-2eba-4af8-be01-7aed09921e1c tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:08.519223 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a2826a0b-2eba-4af8-be01-7aed09921e1c tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:08.519989 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a2826a0b-2eba-4af8-be01-7aed09921e1c tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:08.520426 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a2826a0b-2eba-4af8-be01-7aed09921e1c tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:08.596192 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a2826a0b-2eba-4af8-be01-7aed09921e1c tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f451e0f5c945d8ade3c2a4ea3398c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09e491f80c24a2691e396df0175a057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:08.603602 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a2826a0b-2eba-4af8-be01-7aed09921e1c tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] 10.222.0.45 "GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33" status: 200 len: 1223 microversion: 2.1 time: 0.095377 Jun 16 12:29:08.604236 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 166/336] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:08 2022] GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33 => generated 1223 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:29:09.524509 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-957fec35-5a16-4283-a368-8f322c64d38b tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:09.525243 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-957fec35-5a16-4283-a368-8f322c64d38b tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] [instance: 17f61c67-8ad3-49b1-9efa-045274e693b2] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:09.528960 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-9e65ddb9-a7df-40ac-95e7-71bcde11e2d2 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:09.530430 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-9e65ddb9-a7df-40ac-95e7-71bcde11e2d2 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c7405152-1807-4b2a-8701-ef2b2a8cbafb] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:09.532156 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-957fec35-5a16-4283-a368-8f322c64d38b tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:09.532894 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-957fec35-5a16-4283-a368-8f322c64d38b tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:09.533783 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-957fec35-5a16-4283-a368-8f322c64d38b tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:09.534999 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-957fec35-5a16-4283-a368-8f322c64d38b tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:09.537738 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9e65ddb9-a7df-40ac-95e7-71bcde11e2d2 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:09.538249 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9e65ddb9-a7df-40ac-95e7-71bcde11e2d2 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:09.539015 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9e65ddb9-a7df-40ac-95e7-71bcde11e2d2 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:09.539456 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9e65ddb9-a7df-40ac-95e7-71bcde11e2d2 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:09.741840 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-957fec35-5a16-4283-a368-8f322c64d38b tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e645784fea14d4785df3eefabf77383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01904f10607d4b4bb91b807bff7ba8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:09.745310 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-9e65ddb9-a7df-40ac-95e7-71bcde11e2d2 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:09.750573 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-957fec35-5a16-4283-a368-8f322c64d38b tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] 10.222.0.45 "GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2" status: 200 len: 1358 microversion: 2.1 time: 0.230544 Jun 16 12:29:09.751477 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 171/337] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:09 2022] GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2 => generated 1358 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:29:09.753128 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-9e65ddb9-a7df-40ac-95e7-71bcde11e2d2 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb" status: 200 len: 1509 microversion: 2.1 time: 0.228912 Jun 16 12:29:09.753687 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 167/338] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:09 2022] GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb => generated 1509 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:29:09.756308 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ca5dea5e-bc1d-4801-8a4b-a8581b7b1673 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:09.756910 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ca5dea5e-bc1d-4801-8a4b-a8581b7b1673 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] [instance: c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:09.763959 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ca5dea5e-bc1d-4801-8a4b-a8581b7b1673 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:09.764406 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ca5dea5e-bc1d-4801-8a4b-a8581b7b1673 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:09.765185 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ca5dea5e-bc1d-4801-8a4b-a8581b7b1673 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:09.765614 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ca5dea5e-bc1d-4801-8a4b-a8581b7b1673 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:09.832193 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ca5dea5e-bc1d-4801-8a4b-a8581b7b1673 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f451e0f5c945d8ade3c2a4ea3398c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09e491f80c24a2691e396df0175a057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:09.839456 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ca5dea5e-bc1d-4801-8a4b-a8581b7b1673 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] 10.222.0.45 "GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33" status: 200 len: 1223 microversion: 2.1 time: 0.086846 Jun 16 12:29:09.840743 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 172/339] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:09 2022] GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33 => generated 1223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:29:10.768452 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-53bcb772-f8a5-411e-8bdb-a8db20e0f844 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:10.769080 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-53bcb772-f8a5-411e-8bdb-a8db20e0f844 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] [instance: 17f61c67-8ad3-49b1-9efa-045274e693b2] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:10.771137 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0b05a98c-f60f-48b8-8d89-0f137ed3fe8e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:10.771746 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0b05a98c-f60f-48b8-8d89-0f137ed3fe8e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c7405152-1807-4b2a-8701-ef2b2a8cbafb] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:10.775672 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-53bcb772-f8a5-411e-8bdb-a8db20e0f844 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:10.776119 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-53bcb772-f8a5-411e-8bdb-a8db20e0f844 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:10.776881 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-53bcb772-f8a5-411e-8bdb-a8db20e0f844 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:10.777941 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-53bcb772-f8a5-411e-8bdb-a8db20e0f844 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:10.778200 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0b05a98c-f60f-48b8-8d89-0f137ed3fe8e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:10.778657 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0b05a98c-f60f-48b8-8d89-0f137ed3fe8e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:10.779412 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0b05a98c-f60f-48b8-8d89-0f137ed3fe8e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:10.779846 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0b05a98c-f60f-48b8-8d89-0f137ed3fe8e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:10.976008 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-53bcb772-f8a5-411e-8bdb-a8db20e0f844 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e645784fea14d4785df3eefabf77383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01904f10607d4b4bb91b807bff7ba8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:10.978818 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0b05a98c-f60f-48b8-8d89-0f137ed3fe8e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:10.984279 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-53bcb772-f8a5-411e-8bdb-a8db20e0f844 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] 10.222.0.45 "GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2" status: 200 len: 1358 microversion: 2.1 time: 0.220744 Jun 16 12:29:10.984857 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 168/340] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:10 2022] GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2 => generated 1358 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:29:10.986860 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0b05a98c-f60f-48b8-8d89-0f137ed3fe8e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb" status: 200 len: 1509 microversion: 2.1 time: 0.219486 Jun 16 12:29:10.987409 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 173/341] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:10 2022] GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb => generated 1509 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:29:10.989319 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-cbb533bc-d80b-4c97-a791-cbdf1ed231f0 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:10.989955 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-cbb533bc-d80b-4c97-a791-cbdf1ed231f0 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] [instance: c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:10.995645 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cbb533bc-d80b-4c97-a791-cbdf1ed231f0 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:10.996142 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cbb533bc-d80b-4c97-a791-cbdf1ed231f0 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:10.996905 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cbb533bc-d80b-4c97-a791-cbdf1ed231f0 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:10.997337 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cbb533bc-d80b-4c97-a791-cbdf1ed231f0 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:11.057231 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-cbb533bc-d80b-4c97-a791-cbdf1ed231f0 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f451e0f5c945d8ade3c2a4ea3398c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09e491f80c24a2691e396df0175a057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:11.064544 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-cbb533bc-d80b-4c97-a791-cbdf1ed231f0 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] 10.222.0.45 "GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33" status: 200 len: 1223 microversion: 2.1 time: 0.078748 Jun 16 12:29:11.065176 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 169/342] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:10 2022] GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33 => generated 1223 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:29:12.004035 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e3e5a7c1-6645-4727-a32c-c75e0a32a8af tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:12.004621 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-459140ad-135e-42d4-951e-10cb01976ecc tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:12.005048 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e3e5a7c1-6645-4727-a32c-c75e0a32a8af tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c7405152-1807-4b2a-8701-ef2b2a8cbafb] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:12.005151 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-459140ad-135e-42d4-951e-10cb01976ecc tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] [instance: 17f61c67-8ad3-49b1-9efa-045274e693b2] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:12.007711 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell0:SELECT=4 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:29:12.008405 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell0:SELECT=16 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:29:12.010788 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=4 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:29:12.013709 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e3e5a7c1-6645-4727-a32c-c75e0a32a8af tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:12.013901 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-459140ad-135e-42d4-951e-10cb01976ecc tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:12.014251 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e3e5a7c1-6645-4727-a32c-c75e0a32a8af tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:12.015043 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e3e5a7c1-6645-4727-a32c-c75e0a32a8af tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:12.015285 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-459140ad-135e-42d4-951e-10cb01976ecc tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:12.015522 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e3e5a7c1-6645-4727-a32c-c75e0a32a8af tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:12.016630 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-459140ad-135e-42d4-951e-10cb01976ecc tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:12.017612 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-459140ad-135e-42d4-951e-10cb01976ecc tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:12.341592 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e3e5a7c1-6645-4727-a32c-c75e0a32a8af tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:12.346552 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-459140ad-135e-42d4-951e-10cb01976ecc tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e645784fea14d4785df3eefabf77383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01904f10607d4b4bb91b807bff7ba8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:12.349999 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e3e5a7c1-6645-4727-a32c-c75e0a32a8af tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb" status: 200 len: 1509 microversion: 2.1 time: 0.349777 Jun 16 12:29:12.354072 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-459140ad-135e-42d4-951e-10cb01976ecc tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] 10.222.0.45 "GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2" status: 200 len: 1358 microversion: 2.1 time: 0.353780 Jun 16 12:29:12.358801 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 174/343] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:11 2022] GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2 => generated 1358 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:29:12.361370 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 170/344] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:11 2022] GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb => generated 1509 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:29:12.363524 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8d1a3618-6a39-4304-8b4f-799c667f40b7 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:12.366826 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8d1a3618-6a39-4304-8b4f-799c667f40b7 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] [instance: c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:12.367529 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-9532dbb1-e773-42ca-b06f-6d0dce17f0be req-ab3b43b2-2c72-4188-b931-c1896c25f840 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17f61c67-8ad3-49b1-9efa-045274e693b2", "tag": "49fea4da-1208-4fe6-931a-6a66f0c864cf"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:29:12.374476 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8d1a3618-6a39-4304-8b4f-799c667f40b7 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:12.375477 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8d1a3618-6a39-4304-8b4f-799c667f40b7 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:12.376557 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8d1a3618-6a39-4304-8b4f-799c667f40b7 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:12.377196 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8d1a3618-6a39-4304-8b4f-799c667f40b7 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:12.377556 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-9532dbb1-e773-42ca-b06f-6d0dce17f0be req-ab3b43b2-2c72-4188-b931-c1896c25f840 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:12.378369 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-9532dbb1-e773-42ca-b06f-6d0dce17f0be req-ab3b43b2-2c72-4188-b931-c1896c25f840 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:12.395122 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-9532dbb1-e773-42ca-b06f-6d0dce17f0be req-ab3b43b2-2c72-4188-b931-c1896c25f840 service nova] Creating event network-changed:49fea4da-1208-4fe6-931a-6a66f0c864cf for instance 17f61c67-8ad3-49b1-9efa-045274e693b2 on hv-cinder-84614 Jun 16 12:29:12.401013 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-9532dbb1-e773-42ca-b06f-6d0dce17f0be req-ab3b43b2-2c72-4188-b931-c1896c25f840 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037853 Jun 16 12:29:12.402495 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 171/345] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:29:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:29:12.459600 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8d1a3618-6a39-4304-8b4f-799c667f40b7 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f451e0f5c945d8ade3c2a4ea3398c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09e491f80c24a2691e396df0175a057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:12.467135 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8d1a3618-6a39-4304-8b4f-799c667f40b7 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] 10.222.0.45 "GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33" status: 200 len: 1271 microversion: 2.1 time: 0.107249 Jun 16 12:29:12.467713 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 175/346] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:12 2022] GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33 => generated 1271 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:29:13.372786 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a01068da-ddd2-4a52-a620-d56db1d261e7 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:13.373861 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a01068da-ddd2-4a52-a620-d56db1d261e7 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c7405152-1807-4b2a-8701-ef2b2a8cbafb] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:13.374795 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-775f8b66-8312-4cf6-bf95-116563db7e15 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:13.375436 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-775f8b66-8312-4cf6-bf95-116563db7e15 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] [instance: 17f61c67-8ad3-49b1-9efa-045274e693b2] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:13.382712 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a01068da-ddd2-4a52-a620-d56db1d261e7 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:13.383465 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a01068da-ddd2-4a52-a620-d56db1d261e7 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:13.384320 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a01068da-ddd2-4a52-a620-d56db1d261e7 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:13.384847 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a01068da-ddd2-4a52-a620-d56db1d261e7 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:13.385685 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-775f8b66-8312-4cf6-bf95-116563db7e15 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:13.387154 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-775f8b66-8312-4cf6-bf95-116563db7e15 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:13.387560 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-775f8b66-8312-4cf6-bf95-116563db7e15 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:13.388001 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-775f8b66-8312-4cf6-bf95-116563db7e15 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:13.661835 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a01068da-ddd2-4a52-a620-d56db1d261e7 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:13.676234 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a01068da-ddd2-4a52-a620-d56db1d261e7 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb" status: 200 len: 1515 microversion: 2.1 time: 0.311683 Jun 16 12:29:13.695318 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 172/347] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:13 2022] GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb => generated 1515 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:29:13.707734 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-775f8b66-8312-4cf6-bf95-116563db7e15 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e645784fea14d4785df3eefabf77383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01904f10607d4b4bb91b807bff7ba8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:13.712643 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8a47f38a-4b19-4a93-9c46-7729f4177b8b tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:13.716921 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8a47f38a-4b19-4a93-9c46-7729f4177b8b tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] [instance: c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:13.719575 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-775f8b66-8312-4cf6-bf95-116563db7e15 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] 10.222.0.45 "GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2" status: 200 len: 1358 microversion: 2.1 time: 0.352174 Jun 16 12:29:13.723271 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 176/348] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:13 2022] GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2 => generated 1358 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:29:13.729707 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8a47f38a-4b19-4a93-9c46-7729f4177b8b tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:13.731613 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8a47f38a-4b19-4a93-9c46-7729f4177b8b tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:13.732635 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8a47f38a-4b19-4a93-9c46-7729f4177b8b tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:13.733293 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8a47f38a-4b19-4a93-9c46-7729f4177b8b tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:13.738004 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:29:14.036974 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8a47f38a-4b19-4a93-9c46-7729f4177b8b tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f451e0f5c945d8ade3c2a4ea3398c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09e491f80c24a2691e396df0175a057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:14.059252 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8a47f38a-4b19-4a93-9c46-7729f4177b8b tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] 10.222.0.45 "GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33" status: 200 len: 1319 microversion: 2.1 time: 0.361287 Jun 16 12:29:14.060102 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 173/349] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:13 2022] GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33 => generated 1319 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:29:14.544975 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-f950b2f0-2cc8-40f3-be76-4aeb25df5f39 req-2e407932-9b0e-412b-ab9d-3f95342fa3fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33", "tag": "ca9f1e0d-1fc3-43f4-8519-98d8014759c6"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:29:14.549383 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=64 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:29:14.555463 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-f950b2f0-2cc8-40f3-be76-4aeb25df5f39 req-2e407932-9b0e-412b-ab9d-3f95342fa3fc service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:14.555994 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-f950b2f0-2cc8-40f3-be76-4aeb25df5f39 req-2e407932-9b0e-412b-ab9d-3f95342fa3fc service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:14.568359 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-f950b2f0-2cc8-40f3-be76-4aeb25df5f39 req-2e407932-9b0e-412b-ab9d-3f95342fa3fc service nova] Creating event network-changed:ca9f1e0d-1fc3-43f4-8519-98d8014759c6 for instance c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33 on hv-cinder-84614 Jun 16 12:29:14.575127 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-f950b2f0-2cc8-40f3-be76-4aeb25df5f39 req-2e407932-9b0e-412b-ab9d-3f95342fa3fc service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034257 Jun 16 12:29:14.575823 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 177/350] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:29:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 12:29:14.739719 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-951e36ac-2c19-435e-a3d3-d6bf1a4be5b3 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:14.740967 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-951e36ac-2c19-435e-a3d3-d6bf1a4be5b3 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] [instance: 17f61c67-8ad3-49b1-9efa-045274e693b2] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:14.748100 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-951e36ac-2c19-435e-a3d3-d6bf1a4be5b3 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:14.748555 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-951e36ac-2c19-435e-a3d3-d6bf1a4be5b3 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:14.749327 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-951e36ac-2c19-435e-a3d3-d6bf1a4be5b3 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:14.749766 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-951e36ac-2c19-435e-a3d3-d6bf1a4be5b3 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:14.908840 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-951e36ac-2c19-435e-a3d3-d6bf1a4be5b3 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e645784fea14d4785df3eefabf77383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01904f10607d4b4bb91b807bff7ba8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:14.918384 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-951e36ac-2c19-435e-a3d3-d6bf1a4be5b3 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] 10.222.0.45 "GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2" status: 200 len: 1358 microversion: 2.1 time: 0.182280 Jun 16 12:29:14.926381 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 174/351] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:14 2022] GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2 => generated 1358 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:29:15.077251 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2ff6d279-0a6c-4029-9c3a-3215ff0e1931 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:15.078295 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2ff6d279-0a6c-4029-9c3a-3215ff0e1931 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] [instance: c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:15.085361 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2ff6d279-0a6c-4029-9c3a-3215ff0e1931 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:15.086113 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2ff6d279-0a6c-4029-9c3a-3215ff0e1931 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:15.086913 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2ff6d279-0a6c-4029-9c3a-3215ff0e1931 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:15.087603 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2ff6d279-0a6c-4029-9c3a-3215ff0e1931 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:15.132015 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d00007c0-aeea-4154-8d46-2660cd491a05 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Action: 'create', calling method: .version_select at 0x7f7c72add430>, body: {"keypair": {"name": "tempest-keypair-1219142562", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5uQ0zKgEK5zgTeWhXe/dBWP8rNekzkvOuO7z23wmjmkejoFyLRiHHF+buQElDIPbtEZN1ip6cLWtcv/16db5WwQBUuxglq7gzHuhLZh/4WPiiSCVgP2ql/fX7N5DcMtg=="}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:29:15.147682 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-d00007c0-aeea-4154-8d46-2660cd491a05 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Getting quotas for project 338412f496e246eebc934f348c539335. Resources: {'key_pairs'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 12:29:15.152629 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-d00007c0-aeea-4154-8d46-2660cd491a05 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Getting quotas for user a333ad2fb1c74ef9a666aa591616d7a2 and project 338412f496e246eebc934f348c539335. Resources: {'key_pairs'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 12:29:15.188747 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d00007c0-aeea-4154-8d46-2660cd491a05 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.060222 Jun 16 12:29:15.189407 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 175/352] 10.222.0.45 () {60 vars in 1158 bytes} [Thu Jun 16 12:29:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 12:29:15.483174 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2ff6d279-0a6c-4029-9c3a-3215ff0e1931 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f451e0f5c945d8ade3c2a4ea3398c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09e491f80c24a2691e396df0175a057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:15.487424 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:29:15.492769 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2ff6d279-0a6c-4029-9c3a-3215ff0e1931 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] 10.222.0.45 "GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33" status: 200 len: 1319 microversion: 2.1 time: 0.420382 Jun 16 12:29:15.493834 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 178/353] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:15 2022] GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33 => generated 1319 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:29:15.935998 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8f698f65-ca5e-4e3b-a6d8-0aeb52fd717e tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:15.936612 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8f698f65-ca5e-4e3b-a6d8-0aeb52fd717e tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] [instance: 17f61c67-8ad3-49b1-9efa-045274e693b2] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:15.945844 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8f698f65-ca5e-4e3b-a6d8-0aeb52fd717e tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:15.946327 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8f698f65-ca5e-4e3b-a6d8-0aeb52fd717e tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:15.947111 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8f698f65-ca5e-4e3b-a6d8-0aeb52fd717e tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:15.947555 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8f698f65-ca5e-4e3b-a6d8-0aeb52fd717e tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:16.181945 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8f698f65-ca5e-4e3b-a6d8-0aeb52fd717e tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e645784fea14d4785df3eefabf77383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01904f10607d4b4bb91b807bff7ba8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:16.200752 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8f698f65-ca5e-4e3b-a6d8-0aeb52fd717e tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] 10.222.0.45 "GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2" status: 200 len: 1358 microversion: 2.1 time: 0.266337 Jun 16 12:29:16.203551 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 176/354] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:15 2022] GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2 => generated 1358 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:29:16.512689 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-24527034-9ec0-4261-b538-89ce0699737d tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:16.514266 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-24527034-9ec0-4261-b538-89ce0699737d tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] [instance: c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:16.521795 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-24527034-9ec0-4261-b538-89ce0699737d tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:16.523393 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-24527034-9ec0-4261-b538-89ce0699737d tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:16.524435 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-24527034-9ec0-4261-b538-89ce0699737d tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:16.525229 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-24527034-9ec0-4261-b538-89ce0699737d tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:16.760921 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-24527034-9ec0-4261-b538-89ce0699737d tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f451e0f5c945d8ade3c2a4ea3398c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09e491f80c24a2691e396df0175a057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:16.776547 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-24527034-9ec0-4261-b538-89ce0699737d tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] 10.222.0.45 "GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33" status: 200 len: 1319 microversion: 2.1 time: 0.269584 Jun 16 12:29:16.788496 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 179/355] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:16 2022] GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33 => generated 1319 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:29:17.219210 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5f10695b-e665-4a27-8690-ff3d13fa4908 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:17.219825 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5f10695b-e665-4a27-8690-ff3d13fa4908 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] [instance: 17f61c67-8ad3-49b1-9efa-045274e693b2] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:17.230699 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5f10695b-e665-4a27-8690-ff3d13fa4908 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:17.231521 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5f10695b-e665-4a27-8690-ff3d13fa4908 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:17.232662 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5f10695b-e665-4a27-8690-ff3d13fa4908 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:17.233260 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5f10695b-e665-4a27-8690-ff3d13fa4908 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:17.415717 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5f10695b-e665-4a27-8690-ff3d13fa4908 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e645784fea14d4785df3eefabf77383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01904f10607d4b4bb91b807bff7ba8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:17.425033 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5f10695b-e665-4a27-8690-ff3d13fa4908 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] 10.222.0.45 "GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2" status: 200 len: 1358 microversion: 2.1 time: 0.209538 Jun 16 12:29:17.426073 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 177/356] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:17 2022] GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2 => generated 1358 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:29:17.672550 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1132af29-8ce1-419e-9244-d83386e8b2b4 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1650671229", "imageRef": "c736a2d2-9d0d-41ec-b9fc-971428b0ff7a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "15343ced-c8e8-4ebc-8e76-3a9958a1ff36"}], "security_groups": [{"name": "tempest-securitygroup--1741682744"}], "key_name": "tempest-keypair-1219142562", "user_data": "}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:29:17.777731 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.network.neutron [None req-1132af29-8ce1-419e-9244-d83386e8b2b4 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] validate_networks() for [('15343ced-c8e8-4ebc-8e76-3a9958a1ff36', None, None, None, None, None)] {{(pid=117606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 12:29:17.794579 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4f6b07a7-1521-4bb5-842f-2e42f19e33c4 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:17.795328 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4f6b07a7-1521-4bb5-842f-2e42f19e33c4 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] [instance: c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:17.802060 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4f6b07a7-1521-4bb5-842f-2e42f19e33c4 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:17.802515 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4f6b07a7-1521-4bb5-842f-2e42f19e33c4 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:17.803287 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4f6b07a7-1521-4bb5-842f-2e42f19e33c4 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:17.803886 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4f6b07a7-1521-4bb5-842f-2e42f19e33c4 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:18.024467 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4f6b07a7-1521-4bb5-842f-2e42f19e33c4 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f451e0f5c945d8ade3c2a4ea3398c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09e491f80c24a2691e396df0175a057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:18.032399 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4f6b07a7-1521-4bb5-842f-2e42f19e33c4 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] 10.222.0.45 "GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33" status: 200 len: 1319 microversion: 2.1 time: 0.241874 Jun 16 12:29:18.033201 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 178/357] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:17 2022] GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33 => generated 1319 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:29:18.248520 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-1132af29-8ce1-419e-9244-d83386e8b2b4 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Flavor limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 12:29:18.249666 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-1132af29-8ce1-419e-9244-d83386e8b2b4 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Image limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 12:29:18.250191 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-1132af29-8ce1-419e-9244-d83386e8b2b4 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Flavor pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 12:29:18.250779 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-1132af29-8ce1-419e-9244-d83386e8b2b4 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Image pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 12:29:18.251249 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-1132af29-8ce1-419e-9244-d83386e8b2b4 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 12:29:18.262236 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1132af29-8ce1-419e-9244-d83386e8b2b4 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:18.262747 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1132af29-8ce1-419e-9244-d83386e8b2b4 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:18.263582 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1132af29-8ce1-419e-9244-d83386e8b2b4 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:18.264257 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1132af29-8ce1-419e-9244-d83386e8b2b4 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:18.282700 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-1132af29-8ce1-419e-9244-d83386e8b2b4 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Getting quotas for project 338412f496e246eebc934f348c539335. Resources: {'instances', 'cores', 'ram'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 12:29:18.287138 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-1132af29-8ce1-419e-9244-d83386e8b2b4 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Getting quotas for user a333ad2fb1c74ef9a666aa591616d7a2 and project 338412f496e246eebc934f348c539335. Resources: {'instances', 'cores', 'ram'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 12:29:18.298697 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1132af29-8ce1-419e-9244-d83386e8b2b4 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Going to run 1 instances... {{(pid=117606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 12:29:18.301219 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1132af29-8ce1-419e-9244-d83386e8b2b4 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c2472931-f1a1-4aec-963a-63a7495b733b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c736a2d2-9d0d-41ec-b9fc-971428b0ff7a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 12:29:18.338384 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-2ed44fda-db6b-4600-8f5c-d138824437b0 req-a7a2e40d-c613-46f5-b25a-82f059193c81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17f61c67-8ad3-49b1-9efa-045274e693b2", "name": "network-vif-plugged", "status": "completed", "tag": "49fea4da-1208-4fe6-931a-6a66f0c864cf"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:29:18.351431 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-2ed44fda-db6b-4600-8f5c-d138824437b0 req-a7a2e40d-c613-46f5-b25a-82f059193c81 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:18.352064 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-2ed44fda-db6b-4600-8f5c-d138824437b0 req-a7a2e40d-c613-46f5-b25a-82f059193c81 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:18.360250 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1132af29-8ce1-419e-9244-d83386e8b2b4 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.691881 Jun 16 12:29:18.361663 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 180/358] 10.222.0.45 () {60 vars in 1146 bytes} [Thu Jun 16 12:29:17 2022] POST /compute/v2.1/servers => generated 409 bytes in 694 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 12:29:18.375584 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0a163307-d0df-414f-928e-94ab29e769e6 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:18.376669 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0a163307-d0df-414f-928e-94ab29e769e6 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c2472931-f1a1-4aec-963a-63a7495b733b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:18.395668 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-2ed44fda-db6b-4600-8f5c-d138824437b0 req-a7a2e40d-c613-46f5-b25a-82f059193c81 service nova] Creating event network-vif-plugged:49fea4da-1208-4fe6-931a-6a66f0c864cf for instance 17f61c67-8ad3-49b1-9efa-045274e693b2 on hv-cinder-84614 Jun 16 12:29:18.403589 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-2ed44fda-db6b-4600-8f5c-d138824437b0 req-a7a2e40d-c613-46f5-b25a-82f059193c81 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070683 Jun 16 12:29:18.404524 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 179/359] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:29:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 12:29:18.444094 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5cfd71ae-d61c-4260-9e08-ea2c7e873d2e tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:18.446617 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5cfd71ae-d61c-4260-9e08-ea2c7e873d2e tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] [instance: 17f61c67-8ad3-49b1-9efa-045274e693b2] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:18.457688 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5cfd71ae-d61c-4260-9e08-ea2c7e873d2e tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:18.458431 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0a163307-d0df-414f-928e-94ab29e769e6 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:18.459021 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5cfd71ae-d61c-4260-9e08-ea2c7e873d2e tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:18.459818 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5cfd71ae-d61c-4260-9e08-ea2c7e873d2e tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:18.464336 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5cfd71ae-d61c-4260-9e08-ea2c7e873d2e tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:18.465421 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0a163307-d0df-414f-928e-94ab29e769e6 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b" status: 200 len: 1246 microversion: 2.1 time: 0.097427 Jun 16 12:29:18.466769 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 181/360] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:18 2022] GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b => generated 1246 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:29:18.632518 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5cfd71ae-d61c-4260-9e08-ea2c7e873d2e tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e645784fea14d4785df3eefabf77383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01904f10607d4b4bb91b807bff7ba8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:18.640732 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5cfd71ae-d61c-4260-9e08-ea2c7e873d2e tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] 10.222.0.45 "GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2" status: 200 len: 1358 microversion: 2.1 time: 0.201303 Jun 16 12:29:18.641672 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 180/361] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:18 2022] GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2 => generated 1358 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:29:18.947978 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-099a7ace-003d-4d7d-bf25-519449084adc tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:18.948548 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-099a7ace-003d-4d7d-bf25-519449084adc tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:18.955135 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-099a7ace-003d-4d7d-bf25-519449084adc tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:18.955560 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-099a7ace-003d-4d7d-bf25-519449084adc tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:18.956310 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-099a7ace-003d-4d7d-bf25-519449084adc tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:18.956742 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-099a7ace-003d-4d7d-bf25-519449084adc tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:18.979395 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-099a7ace-003d-4d7d-bf25-519449084adc tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df/ips" status: 200 len: 149 microversion: 2.20 time: 0.035215 Jun 16 12:29:18.980509 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 182/362] 10.222.0.45 () {60 vars in 1288 bytes} [Thu Jun 16 12:29:18 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df/ips => generated 149 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 12:29:19.049658 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-61759363-092c-421a-a06c-c8657ca74df8 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:19.050526 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-61759363-092c-421a-a06c-c8657ca74df8 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] [instance: c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:19.056390 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-61759363-092c-421a-a06c-c8657ca74df8 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:19.056848 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-61759363-092c-421a-a06c-c8657ca74df8 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:19.057608 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-61759363-092c-421a-a06c-c8657ca74df8 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:19.058097 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-61759363-092c-421a-a06c-c8657ca74df8 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:19.200397 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-61759363-092c-421a-a06c-c8657ca74df8 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f451e0f5c945d8ade3c2a4ea3398c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09e491f80c24a2691e396df0175a057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:19.208311 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-61759363-092c-421a-a06c-c8657ca74df8 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] 10.222.0.45 "GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33" status: 200 len: 1319 microversion: 2.1 time: 0.162380 Jun 16 12:29:19.209173 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 181/363] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:19 2022] GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:29:19.484564 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9bcfe729-c808-4973-8488-5daca58b9b4f tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:19.485174 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9bcfe729-c808-4973-8488-5daca58b9b4f tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c2472931-f1a1-4aec-963a-63a7495b733b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:19.491319 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9bcfe729-c808-4973-8488-5daca58b9b4f tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:19.491708 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9bcfe729-c808-4973-8488-5daca58b9b4f tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:19.492460 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9bcfe729-c808-4973-8488-5daca58b9b4f tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:19.492896 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9bcfe729-c808-4973-8488-5daca58b9b4f tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:19.553754 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9bcfe729-c808-4973-8488-5daca58b9b4f tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:19.561604 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9bcfe729-c808-4973-8488-5daca58b9b4f tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b" status: 200 len: 1250 microversion: 2.1 time: 0.080976 Jun 16 12:29:19.562239 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 183/364] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:19 2022] GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b => generated 1250 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:29:19.658170 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-582907cf-a26c-43dc-9f9a-c1f092812827 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:19.658777 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-582907cf-a26c-43dc-9f9a-c1f092812827 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] [instance: 17f61c67-8ad3-49b1-9efa-045274e693b2] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:19.664954 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-582907cf-a26c-43dc-9f9a-c1f092812827 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:19.665397 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-582907cf-a26c-43dc-9f9a-c1f092812827 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:19.666319 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-582907cf-a26c-43dc-9f9a-c1f092812827 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:19.666767 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-582907cf-a26c-43dc-9f9a-c1f092812827 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:19.803062 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-582907cf-a26c-43dc-9f9a-c1f092812827 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e645784fea14d4785df3eefabf77383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01904f10607d4b4bb91b807bff7ba8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:19.810677 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-582907cf-a26c-43dc-9f9a-c1f092812827 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] 10.222.0.45 "GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2" status: 200 len: 1358 microversion: 2.1 time: 0.156794 Jun 16 12:29:19.811251 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 182/365] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:19 2022] GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:29:20.230812 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f89c7b6f-0937-49bd-978a-48ee230b405d tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:20.232145 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f89c7b6f-0937-49bd-978a-48ee230b405d tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] [instance: c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:20.240395 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f89c7b6f-0937-49bd-978a-48ee230b405d tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:20.241143 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f89c7b6f-0937-49bd-978a-48ee230b405d tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:20.242225 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f89c7b6f-0937-49bd-978a-48ee230b405d tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:20.242992 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f89c7b6f-0937-49bd-978a-48ee230b405d tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:20.465923 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f89c7b6f-0937-49bd-978a-48ee230b405d tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f451e0f5c945d8ade3c2a4ea3398c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09e491f80c24a2691e396df0175a057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:20.473774 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f89c7b6f-0937-49bd-978a-48ee230b405d tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] 10.222.0.45 "GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33" status: 200 len: 1319 microversion: 2.1 time: 0.251021 Jun 16 12:29:20.474386 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 184/366] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:20 2022] GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33 => generated 1319 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:29:20.578712 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c4d26e8b-922c-4a38-9283-ea704d354957 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:20.579397 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c4d26e8b-922c-4a38-9283-ea704d354957 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c2472931-f1a1-4aec-963a-63a7495b733b] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:20.585528 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c4d26e8b-922c-4a38-9283-ea704d354957 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:20.587052 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c4d26e8b-922c-4a38-9283-ea704d354957 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:20.588008 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c4d26e8b-922c-4a38-9283-ea704d354957 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:20.588874 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c4d26e8b-922c-4a38-9283-ea704d354957 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:20.653711 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c4d26e8b-922c-4a38-9283-ea704d354957 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:20.661812 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c4d26e8b-922c-4a38-9283-ea704d354957 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b" status: 200 len: 1298 microversion: 2.1 time: 0.087152 Jun 16 12:29:20.662434 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 183/367] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:20 2022] GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b => generated 1298 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:29:20.827657 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ce25f125-5484-4036-8a61-b72b5aec84f7 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:20.828187 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ce25f125-5484-4036-8a61-b72b5aec84f7 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] [instance: 17f61c67-8ad3-49b1-9efa-045274e693b2] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:20.834143 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ce25f125-5484-4036-8a61-b72b5aec84f7 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:20.834589 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ce25f125-5484-4036-8a61-b72b5aec84f7 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:20.835341 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ce25f125-5484-4036-8a61-b72b5aec84f7 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:20.835767 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ce25f125-5484-4036-8a61-b72b5aec84f7 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:20.967645 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ce25f125-5484-4036-8a61-b72b5aec84f7 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e645784fea14d4785df3eefabf77383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01904f10607d4b4bb91b807bff7ba8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:20.976411 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ce25f125-5484-4036-8a61-b72b5aec84f7 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] 10.222.0.45 "GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2" status: 200 len: 1358 microversion: 2.1 time: 0.153275 Jun 16 12:29:20.986185 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 185/368] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:20 2022] GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:29:21.491781 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4f47fa44-83b6-403a-a812-7616c5bc0d2e tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:21.492467 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4f47fa44-83b6-403a-a812-7616c5bc0d2e tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] [instance: c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:21.499230 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4f47fa44-83b6-403a-a812-7616c5bc0d2e tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:21.499681 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4f47fa44-83b6-403a-a812-7616c5bc0d2e tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:21.500444 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4f47fa44-83b6-403a-a812-7616c5bc0d2e tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:21.500882 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4f47fa44-83b6-403a-a812-7616c5bc0d2e tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:21.631749 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4f47fa44-83b6-403a-a812-7616c5bc0d2e tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f451e0f5c945d8ade3c2a4ea3398c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09e491f80c24a2691e396df0175a057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:21.639552 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4f47fa44-83b6-403a-a812-7616c5bc0d2e tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] 10.222.0.45 "GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33" status: 200 len: 1319 microversion: 2.1 time: 0.151506 Jun 16 12:29:21.640019 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 184/369] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:21 2022] GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:29:21.656619 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-108797ad-a6e5-4321-9030-fa25a8a3df73 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:29:21.660585 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-108797ad-a6e5-4321-9030-fa25a8a3df73 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:21.666920 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-108797ad-a6e5-4321-9030-fa25a8a3df73 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:21.668320 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-108797ad-a6e5-4321-9030-fa25a8a3df73 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:21.669207 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-108797ad-a6e5-4321-9030-fa25a8a3df73 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:21.669899 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-108797ad-a6e5-4321-9030-fa25a8a3df73 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:21.679466 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e195c8e5-911a-4d04-bca0-20013926e78f tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:21.680068 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e195c8e5-911a-4d04-bca0-20013926e78f tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c2472931-f1a1-4aec-963a-63a7495b733b] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:21.692055 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e195c8e5-911a-4d04-bca0-20013926e78f tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:21.692566 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e195c8e5-911a-4d04-bca0-20013926e78f tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:21.694059 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e195c8e5-911a-4d04-bca0-20013926e78f tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:21.694536 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e195c8e5-911a-4d04-bca0-20013926e78f tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:21.705975 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.objects.instance [None req-108797ad-a6e5-4321-9030-fa25a8a3df73 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lazy-loading 'flavor' on Instance uuid 8528919e-1e7a-4807-9b11-ae225e65d4df {{(pid=117606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 12:29:21.774824 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e195c8e5-911a-4d04-bca0-20013926e78f tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:21.782569 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e195c8e5-911a-4d04-bca0-20013926e78f tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b" status: 200 len: 1306 microversion: 2.1 time: 0.106765 Jun 16 12:29:21.783664 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 185/370] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:21 2022] GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b => generated 1306 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:29:21.993941 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-96d9343d-ca84-4670-8c99-44026409ca39 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:21.994852 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-96d9343d-ca84-4670-8c99-44026409ca39 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] [instance: 17f61c67-8ad3-49b1-9efa-045274e693b2] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:22.004230 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-96d9343d-ca84-4670-8c99-44026409ca39 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:22.005250 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-96d9343d-ca84-4670-8c99-44026409ca39 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:22.006445 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-96d9343d-ca84-4670-8c99-44026409ca39 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:22.007088 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-96d9343d-ca84-4670-8c99-44026409ca39 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:22.052088 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-108797ad-a6e5-4321-9030-fa25a8a3df73 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "POST /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df/action" status: 202 len: 0 microversion: 2.20 time: 0.399807 Jun 16 12:29:22.053139 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 186/371] 10.222.0.45 () {62 vars in 1318 bytes} [Thu Jun 16 12:29:21 2022] POST /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df/action => generated 0 bytes in 402 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 12:29:22.062002 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-721cfd97-889f-46a2-9c69-bccf7a23c1d9 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:22.062800 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-721cfd97-889f-46a2-9c69-bccf7a23c1d9 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:22.070911 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-721cfd97-889f-46a2-9c69-bccf7a23c1d9 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:22.071456 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-721cfd97-889f-46a2-9c69-bccf7a23c1d9 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:22.072306 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-721cfd97-889f-46a2-9c69-bccf7a23c1d9 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:22.072817 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-721cfd97-889f-46a2-9c69-bccf7a23c1d9 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:22.191332 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-96d9343d-ca84-4670-8c99-44026409ca39 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e645784fea14d4785df3eefabf77383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01904f10607d4b4bb91b807bff7ba8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:22.201540 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-96d9343d-ca84-4670-8c99-44026409ca39 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] 10.222.0.45 "GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2" status: 200 len: 1358 microversion: 2.1 time: 0.211644 Jun 16 12:29:22.202457 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 186/372] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:21 2022] GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2 => generated 1358 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:29:22.240811 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-721cfd97-889f-46a2-9c69-bccf7a23c1d9 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:22.249406 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-721cfd97-889f-46a2-9c69-bccf7a23c1d9 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:22.251000 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-721cfd97-889f-46a2-9c69-bccf7a23c1d9 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:22.252189 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-721cfd97-889f-46a2-9c69-bccf7a23c1d9 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1721 microversion: 2.20 time: 0.195048 Jun 16 12:29:22.252745 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 187/373] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:29:22 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1721 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 12:29:22.365612 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-689281a7-49b1-4f94-bb74-4b35201db541 req-c4d95e13-8c42-4287-a76a-052f687759ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33", "name": "network-vif-plugged", "status": "completed", "tag": "ca9f1e0d-1fc3-43f4-8519-98d8014759c6"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:29:22.376415 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-689281a7-49b1-4f94-bb74-4b35201db541 req-c4d95e13-8c42-4287-a76a-052f687759ec service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:22.376935 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-689281a7-49b1-4f94-bb74-4b35201db541 req-c4d95e13-8c42-4287-a76a-052f687759ec service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:22.389387 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-689281a7-49b1-4f94-bb74-4b35201db541 req-c4d95e13-8c42-4287-a76a-052f687759ec service nova] Creating event network-vif-plugged:ca9f1e0d-1fc3-43f4-8519-98d8014759c6 for instance c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33 on hv-cinder-84614 Jun 16 12:29:22.394447 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-689281a7-49b1-4f94-bb74-4b35201db541 req-c4d95e13-8c42-4287-a76a-052f687759ec service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035190 Jun 16 12:29:22.395442 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 187/374] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:29:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:29:22.656528 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-028e8110-db44-499b-a9ba-5e5ae93ab18f tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:22.657397 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-028e8110-db44-499b-a9ba-5e5ae93ab18f tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] [instance: c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:22.664648 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-028e8110-db44-499b-a9ba-5e5ae93ab18f tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:22.665306 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-028e8110-db44-499b-a9ba-5e5ae93ab18f tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:22.666273 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-028e8110-db44-499b-a9ba-5e5ae93ab18f tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:22.666717 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-028e8110-db44-499b-a9ba-5e5ae93ab18f tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:22.798689 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-028e8110-db44-499b-a9ba-5e5ae93ab18f tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f451e0f5c945d8ade3c2a4ea3398c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09e491f80c24a2691e396df0175a057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:22.802821 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-52e8949e-f14d-41ae-9724-ddc4a0dd48c8 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:22.804027 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-52e8949e-f14d-41ae-9724-ddc4a0dd48c8 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c2472931-f1a1-4aec-963a-63a7495b733b] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:22.812906 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-52e8949e-f14d-41ae-9724-ddc4a0dd48c8 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:22.813668 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-52e8949e-f14d-41ae-9724-ddc4a0dd48c8 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:22.814775 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-52e8949e-f14d-41ae-9724-ddc4a0dd48c8 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:22.815477 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-52e8949e-f14d-41ae-9724-ddc4a0dd48c8 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:22.818785 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-028e8110-db44-499b-a9ba-5e5ae93ab18f tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] 10.222.0.45 "GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33" status: 200 len: 1319 microversion: 2.1 time: 0.165899 Jun 16 12:29:22.820107 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 188/375] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:22 2022] GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:29:22.977614 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-52e8949e-f14d-41ae-9724-ddc4a0dd48c8 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:22.987612 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-52e8949e-f14d-41ae-9724-ddc4a0dd48c8 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b" status: 200 len: 1372 microversion: 2.1 time: 0.189316 Jun 16 12:29:22.988758 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 188/376] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:22 2022] GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b => generated 1372 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:29:23.221887 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b5330da1-bcc6-4e05-b532-c02cfbbf5ce5 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:23.222758 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b5330da1-bcc6-4e05-b532-c02cfbbf5ce5 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] [instance: 17f61c67-8ad3-49b1-9efa-045274e693b2] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:23.236998 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b5330da1-bcc6-4e05-b532-c02cfbbf5ce5 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:23.237469 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b5330da1-bcc6-4e05-b532-c02cfbbf5ce5 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:23.238354 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b5330da1-bcc6-4e05-b532-c02cfbbf5ce5 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:23.238803 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b5330da1-bcc6-4e05-b532-c02cfbbf5ce5 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:23.273186 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b6135148-d7b6-469e-afc1-50b34e10eb01 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:23.273796 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b6135148-d7b6-469e-afc1-50b34e10eb01 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:23.280641 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b6135148-d7b6-469e-afc1-50b34e10eb01 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:23.281093 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b6135148-d7b6-469e-afc1-50b34e10eb01 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:23.286549 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b6135148-d7b6-469e-afc1-50b34e10eb01 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:23.287692 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b6135148-d7b6-469e-afc1-50b34e10eb01 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:23.448375 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b5330da1-bcc6-4e05-b532-c02cfbbf5ce5 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e645784fea14d4785df3eefabf77383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01904f10607d4b4bb91b807bff7ba8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:23.457132 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b5330da1-bcc6-4e05-b532-c02cfbbf5ce5 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] 10.222.0.45 "GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2" status: 200 len: 1548 microversion: 2.1 time: 0.240307 Jun 16 12:29:23.464444 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 189/377] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:23 2022] GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2 => generated 1548 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:29:23.480516 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c3e6c575-f20c-4eaa-bf94-94da4679655c tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:23.481249 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c3e6c575-f20c-4eaa-bf94-94da4679655c tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] [instance: 17f61c67-8ad3-49b1-9efa-045274e693b2] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:23.489120 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c3e6c575-f20c-4eaa-bf94-94da4679655c tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:23.489672 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c3e6c575-f20c-4eaa-bf94-94da4679655c tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:23.490543 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c3e6c575-f20c-4eaa-bf94-94da4679655c tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:23.491184 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c3e6c575-f20c-4eaa-bf94-94da4679655c tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:23.540516 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b6135148-d7b6-469e-afc1-50b34e10eb01 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:23.551997 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b6135148-d7b6-469e-afc1-50b34e10eb01 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:23.556771 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b6135148-d7b6-469e-afc1-50b34e10eb01 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:23.559103 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b6135148-d7b6-469e-afc1-50b34e10eb01 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1721 microversion: 2.20 time: 0.290367 Jun 16 12:29:23.560131 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 189/378] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:29:23 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1721 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 12:29:23.656474 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c3e6c575-f20c-4eaa-bf94-94da4679655c tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e645784fea14d4785df3eefabf77383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01904f10607d4b4bb91b807bff7ba8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:23.665823 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c3e6c575-f20c-4eaa-bf94-94da4679655c tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] 10.222.0.45 "GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2" status: 200 len: 1548 microversion: 2.1 time: 0.192254 Jun 16 12:29:23.669920 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 190/379] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:23 2022] GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2 => generated 1548 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:29:23.682542 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-bfb32f07-9e6c-43a8-9a31-28e450e267ea tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:23.688232 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-bfb32f07-9e6c-43a8-9a31-28e450e267ea tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2e645784fea14d4785df3eefabf77383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01904f10607d4b4bb91b807bff7ba8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:23.689283 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-bfb32f07-9e6c-43a8-9a31-28e450e267ea tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Searching by: {'deleted': False, 'project_id': '01904f10607d4b4bb91b807bff7ba8ee'} {{(pid=117607) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 12:29:23.696460 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bfb32f07-9e6c-43a8-9a31-28e450e267ea tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:23.697125 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bfb32f07-9e6c-43a8-9a31-28e450e267ea tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:23.698124 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bfb32f07-9e6c-43a8-9a31-28e450e267ea tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:23.699116 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bfb32f07-9e6c-43a8-9a31-28e450e267ea tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:23.726144 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-3b6f1d43-e7e2-4852-a2cb-81265bb29d97 req-dee20eda-f0ed-47f4-b630-481499d672d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2472931-f1a1-4aec-963a-63a7495b733b", "tag": "2aacd7af-3e65-4a78-9162-adc1a6afdbc1"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:29:23.735386 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-3b6f1d43-e7e2-4852-a2cb-81265bb29d97 req-dee20eda-f0ed-47f4-b630-481499d672d1 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:23.735935 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-3b6f1d43-e7e2-4852-a2cb-81265bb29d97 req-dee20eda-f0ed-47f4-b630-481499d672d1 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:23.750846 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-3b6f1d43-e7e2-4852-a2cb-81265bb29d97 req-dee20eda-f0ed-47f4-b630-481499d672d1 service nova] Creating event network-changed:2aacd7af-3e65-4a78-9162-adc1a6afdbc1 for instance c2472931-f1a1-4aec-963a-63a7495b733b on hv-cinder-84614 Jun 16 12:29:23.756491 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-3b6f1d43-e7e2-4852-a2cb-81265bb29d97 req-dee20eda-f0ed-47f4-b630-481499d672d1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034417 Jun 16 12:29:23.757079 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 191/380] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:29:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:29:23.814987 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.multi_cell_list [None req-bfb32f07-9e6c-43a8-9a31-28e450e267ea tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117607) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 16 12:29:23.836952 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-65f4ad55-1f21-49a5-931b-0505c46cc28f tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:23.837655 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-65f4ad55-1f21-49a5-931b-0505c46cc28f tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] [instance: c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:23.847662 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-65f4ad55-1f21-49a5-931b-0505c46cc28f tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:23.848295 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-65f4ad55-1f21-49a5-931b-0505c46cc28f tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:23.849148 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-65f4ad55-1f21-49a5-931b-0505c46cc28f tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:23.849659 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-65f4ad55-1f21-49a5-931b-0505c46cc28f tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:23.921177 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-bfb32f07-9e6c-43a8-9a31-28e450e267ea tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] 10.222.0.45 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.242792 Jun 16 12:29:23.921765 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 190/381] 10.222.0.45 () {58 vars in 1124 bytes} [Thu Jun 16 12:29:23 2022] GET /compute/v2.1/servers => generated 343 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:29:23.934067 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-67cedf53-4287-4ac5-a09b-b5062425922a tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:23.934771 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-67cedf53-4287-4ac5-a09b-b5062425922a tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] [instance: 17f61c67-8ad3-49b1-9efa-045274e693b2] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:23.941406 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-67cedf53-4287-4ac5-a09b-b5062425922a tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:23.941857 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-67cedf53-4287-4ac5-a09b-b5062425922a tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:23.942791 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-67cedf53-4287-4ac5-a09b-b5062425922a tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:23.943231 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-67cedf53-4287-4ac5-a09b-b5062425922a tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:24.003664 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-65f4ad55-1f21-49a5-931b-0505c46cc28f tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f451e0f5c945d8ade3c2a4ea3398c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09e491f80c24a2691e396df0175a057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:24.011222 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-65f4ad55-1f21-49a5-931b-0505c46cc28f tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] 10.222.0.45 "GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33" status: 200 len: 1319 microversion: 2.1 time: 0.178291 Jun 16 12:29:24.012219 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 192/382] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:23 2022] GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33 => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:29:24.016607 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1ecb0f39-c235-4c3c-8cb5-1e0069f7376e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:24.017202 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1ecb0f39-c235-4c3c-8cb5-1e0069f7376e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c2472931-f1a1-4aec-963a-63a7495b733b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:24.023053 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1ecb0f39-c235-4c3c-8cb5-1e0069f7376e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:24.023692 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1ecb0f39-c235-4c3c-8cb5-1e0069f7376e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:24.024452 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1ecb0f39-c235-4c3c-8cb5-1e0069f7376e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:24.024880 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1ecb0f39-c235-4c3c-8cb5-1e0069f7376e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:24.130469 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-67cedf53-4287-4ac5-a09b-b5062425922a tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e645784fea14d4785df3eefabf77383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01904f10607d4b4bb91b807bff7ba8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:24.132790 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:29:24.140166 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-67cedf53-4287-4ac5-a09b-b5062425922a tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] 10.222.0.45 "GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2" status: 200 len: 1548 microversion: 2.1 time: 0.212258 Jun 16 12:29:24.140741 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 191/383] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:23 2022] GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2 => generated 1548 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:29:24.176807 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1ecb0f39-c235-4c3c-8cb5-1e0069f7376e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:24.184626 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1ecb0f39-c235-4c3c-8cb5-1e0069f7376e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b" status: 200 len: 1372 microversion: 2.1 time: 0.171462 Jun 16 12:29:24.185195 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 193/384] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:24 2022] GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b => generated 1372 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:29:24.576756 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-99c13188-fa65-43de-b914-aadb592683a9 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:24.577810 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-99c13188-fa65-43de-b914-aadb592683a9 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:24.585398 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-99c13188-fa65-43de-b914-aadb592683a9 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:24.586074 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-99c13188-fa65-43de-b914-aadb592683a9 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:24.586841 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-99c13188-fa65-43de-b914-aadb592683a9 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:24.587500 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-99c13188-fa65-43de-b914-aadb592683a9 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:24.730634 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-99c13188-fa65-43de-b914-aadb592683a9 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:24.739271 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-99c13188-fa65-43de-b914-aadb592683a9 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:24.740767 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-99c13188-fa65-43de-b914-aadb592683a9 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:24.741936 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-99c13188-fa65-43de-b914-aadb592683a9 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1721 microversion: 2.20 time: 0.169407 Jun 16 12:29:24.742815 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 192/385] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:29:24 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:29:25.029339 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-aba8b238-1a8e-4d3e-b7fc-e8aef024af15 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:25.029998 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-aba8b238-1a8e-4d3e-b7fc-e8aef024af15 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] [instance: c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:25.036400 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-aba8b238-1a8e-4d3e-b7fc-e8aef024af15 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:25.036853 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-aba8b238-1a8e-4d3e-b7fc-e8aef024af15 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:25.037629 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-aba8b238-1a8e-4d3e-b7fc-e8aef024af15 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:25.038099 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-aba8b238-1a8e-4d3e-b7fc-e8aef024af15 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:25.200911 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-aba8b238-1a8e-4d3e-b7fc-e8aef024af15 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f451e0f5c945d8ade3c2a4ea3398c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09e491f80c24a2691e396df0175a057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:25.202023 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2a93ca4d-1d58-4c8c-8815-e2310f7937e9 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:25.203343 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2a93ca4d-1d58-4c8c-8815-e2310f7937e9 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c2472931-f1a1-4aec-963a-63a7495b733b] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:25.206258 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell0:SELECT=4 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:29:25.217403 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2a93ca4d-1d58-4c8c-8815-e2310f7937e9 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:25.218163 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2a93ca4d-1d58-4c8c-8815-e2310f7937e9 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:25.219019 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2a93ca4d-1d58-4c8c-8815-e2310f7937e9 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:25.219550 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2a93ca4d-1d58-4c8c-8815-e2310f7937e9 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:25.223654 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-aba8b238-1a8e-4d3e-b7fc-e8aef024af15 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] 10.222.0.45 "GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33" status: 200 len: 1507 microversion: 2.1 time: 0.197685 Jun 16 12:29:25.225855 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 194/386] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:25 2022] GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33 => generated 1507 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:29:25.412312 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2a93ca4d-1d58-4c8c-8815-e2310f7937e9 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:25.430836 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2a93ca4d-1d58-4c8c-8815-e2310f7937e9 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b" status: 200 len: 1372 microversion: 2.1 time: 0.233429 Jun 16 12:29:25.431370 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 193/387] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:25 2022] GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b => generated 1372 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:29:25.722820 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c6d29a92-2a74-426a-8ebf-bd8f4ddd090e tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "41fa0db8-1b87-42e9-8562-decb00630929"}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:29:25.724600 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c6d29a92-2a74-426a-8ebf-bd8f4ddd090e tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] [instance: 17f61c67-8ad3-49b1-9efa-045274e693b2] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:25.732127 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c6d29a92-2a74-426a-8ebf-bd8f4ddd090e tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:25.732910 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c6d29a92-2a74-426a-8ebf-bd8f4ddd090e tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:25.733994 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c6d29a92-2a74-426a-8ebf-bd8f4ddd090e tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:25.758399 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c6d29a92-2a74-426a-8ebf-bd8f4ddd090e tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:25.764644 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-098c494e-1df0-4381-8583-72b9b67d801d tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:25.766242 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-098c494e-1df0-4381-8583-72b9b67d801d tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:25.773366 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-098c494e-1df0-4381-8583-72b9b67d801d tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:25.774397 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-098c494e-1df0-4381-8583-72b9b67d801d tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:25.775434 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-098c494e-1df0-4381-8583-72b9b67d801d tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:25.776257 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-098c494e-1df0-4381-8583-72b9b67d801d tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:25.995260 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-098c494e-1df0-4381-8583-72b9b67d801d tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:26.003226 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-098c494e-1df0-4381-8583-72b9b67d801d tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:26.004729 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-098c494e-1df0-4381-8583-72b9b67d801d tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:26.005927 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-098c494e-1df0-4381-8583-72b9b67d801d tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1721 microversion: 2.20 time: 0.249277 Jun 16 12:29:26.006483 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 194/388] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:29:25 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1721 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 12:29:26.448988 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b2efd905-656a-444b-8054-ebce1068a37a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:26.449689 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b2efd905-656a-444b-8054-ebce1068a37a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c2472931-f1a1-4aec-963a-63a7495b733b] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:26.456023 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b2efd905-656a-444b-8054-ebce1068a37a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:26.456479 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b2efd905-656a-444b-8054-ebce1068a37a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:26.457279 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b2efd905-656a-444b-8054-ebce1068a37a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:26.457720 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b2efd905-656a-444b-8054-ebce1068a37a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:26.596196 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b2efd905-656a-444b-8054-ebce1068a37a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:26.603776 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b2efd905-656a-444b-8054-ebce1068a37a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b" status: 200 len: 1372 microversion: 2.1 time: 0.158849 Jun 16 12:29:26.605176 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 195/389] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:26 2022] GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b => generated 1372 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:29:27.025687 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f281ccd0-75ba-49bb-8ae8-3b3837715d6b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:27.025687 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f281ccd0-75ba-49bb-8ae8-3b3837715d6b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:27.031618 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f281ccd0-75ba-49bb-8ae8-3b3837715d6b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:27.032217 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f281ccd0-75ba-49bb-8ae8-3b3837715d6b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:27.032994 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f281ccd0-75ba-49bb-8ae8-3b3837715d6b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:27.033436 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f281ccd0-75ba-49bb-8ae8-3b3837715d6b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:27.176449 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f281ccd0-75ba-49bb-8ae8-3b3837715d6b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:27.184963 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f281ccd0-75ba-49bb-8ae8-3b3837715d6b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:27.186473 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f281ccd0-75ba-49bb-8ae8-3b3837715d6b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:27.187605 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f281ccd0-75ba-49bb-8ae8-3b3837715d6b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1721 microversion: 2.20 time: 0.167012 Jun 16 12:29:27.188160 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 196/390] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:29:27 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 12:29:27.622265 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-59269c1c-54e9-4168-bc18-d092e7262026 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:27.622892 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-59269c1c-54e9-4168-bc18-d092e7262026 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c2472931-f1a1-4aec-963a-63a7495b733b] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:27.631757 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-59269c1c-54e9-4168-bc18-d092e7262026 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:27.632632 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-59269c1c-54e9-4168-bc18-d092e7262026 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:27.633615 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-59269c1c-54e9-4168-bc18-d092e7262026 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:27.634097 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-59269c1c-54e9-4168-bc18-d092e7262026 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:27.870787 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-59269c1c-54e9-4168-bc18-d092e7262026 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:27.878089 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-59269c1c-54e9-4168-bc18-d092e7262026 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b" status: 200 len: 1372 microversion: 2.1 time: 0.259889 Jun 16 12:29:27.878634 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 197/391] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:27 2022] GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b => generated 1372 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:29:28.208457 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c7596b45-017d-4cbf-b8de-d63d1c230c4b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:28.209306 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c7596b45-017d-4cbf-b8de-d63d1c230c4b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:28.216934 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c7596b45-017d-4cbf-b8de-d63d1c230c4b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:28.217386 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c7596b45-017d-4cbf-b8de-d63d1c230c4b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:28.218199 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c7596b45-017d-4cbf-b8de-d63d1c230c4b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:28.218639 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c7596b45-017d-4cbf-b8de-d63d1c230c4b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:28.272796 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=2 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:29:28.352114 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c7596b45-017d-4cbf-b8de-d63d1c230c4b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:28.362602 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c7596b45-017d-4cbf-b8de-d63d1c230c4b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:28.364254 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c7596b45-017d-4cbf-b8de-d63d1c230c4b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:28.365511 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c7596b45-017d-4cbf-b8de-d63d1c230c4b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1721 microversion: 2.20 time: 0.161147 Jun 16 12:29:28.366287 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 198/392] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:29:28 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 12:29:28.462853 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=8 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:29:28.677074 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:29:28.810292 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c6d29a92-2a74-426a-8ebf-bd8f4ddd090e tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] 10.222.0.45 "POST /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.091765 Jun 16 12:29:28.815548 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 195/393] 10.222.0.45 () {60 vars in 1322 bytes} [Thu Jun 16 12:29:25 2022] POST /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2/os-volume_attachments => generated 194 bytes in 3093 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:29:28.895807 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-276e6e8b-6c06-4b17-ae8d-d5dc699b7887 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:28.896583 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-276e6e8b-6c06-4b17-ae8d-d5dc699b7887 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c2472931-f1a1-4aec-963a-63a7495b733b] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:28.903821 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-276e6e8b-6c06-4b17-ae8d-d5dc699b7887 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:28.904409 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-276e6e8b-6c06-4b17-ae8d-d5dc699b7887 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:28.905305 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-276e6e8b-6c06-4b17-ae8d-d5dc699b7887 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:28.905742 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-276e6e8b-6c06-4b17-ae8d-d5dc699b7887 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:29.075412 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-276e6e8b-6c06-4b17-ae8d-d5dc699b7887 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:29.083816 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-276e6e8b-6c06-4b17-ae8d-d5dc699b7887 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b" status: 200 len: 1372 microversion: 2.1 time: 0.191370 Jun 16 12:29:29.083953 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 199/394] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:28 2022] GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b => generated 1372 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:29:29.385635 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-497cc6ab-9951-44e6-8b1d-e6e0c3a312cd tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:29.386511 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-497cc6ab-9951-44e6-8b1d-e6e0c3a312cd tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:29.392767 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-497cc6ab-9951-44e6-8b1d-e6e0c3a312cd tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:29.393282 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-497cc6ab-9951-44e6-8b1d-e6e0c3a312cd tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:29.394169 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-497cc6ab-9951-44e6-8b1d-e6e0c3a312cd tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:29.394639 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-497cc6ab-9951-44e6-8b1d-e6e0c3a312cd tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:29.528602 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-497cc6ab-9951-44e6-8b1d-e6e0c3a312cd tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:29.537006 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-497cc6ab-9951-44e6-8b1d-e6e0c3a312cd tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:29.538532 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-497cc6ab-9951-44e6-8b1d-e6e0c3a312cd tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:29.539677 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-497cc6ab-9951-44e6-8b1d-e6e0c3a312cd tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1721 microversion: 2.20 time: 0.158803 Jun 16 12:29:29.540220 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 196/395] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:29:29 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:29:30.100876 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5de651c5-4e9e-4415-bd4d-42af8a652607 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:30.101487 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5de651c5-4e9e-4415-bd4d-42af8a652607 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c2472931-f1a1-4aec-963a-63a7495b733b] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:30.108290 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5de651c5-4e9e-4415-bd4d-42af8a652607 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:30.108741 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5de651c5-4e9e-4415-bd4d-42af8a652607 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:30.109535 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5de651c5-4e9e-4415-bd4d-42af8a652607 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:30.109996 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5de651c5-4e9e-4415-bd4d-42af8a652607 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:30.180642 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-298fc371-8021-4c98-9c69-177b4046b4ce tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1789578898", "imageRef": "c736a2d2-9d0d-41ec-b9fc-971428b0ff7a", "flavorRef": "452", "networks": [{"uuid": "8e138a49-8247-46da-9027-19340c6518d7"}]}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:29:30.239767 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.network.neutron [None req-298fc371-8021-4c98-9c69-177b4046b4ce tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] validate_networks() for [('8e138a49-8247-46da-9027-19340c6518d7', None, None, None, None, None)] {{(pid=117606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 12:29:30.278775 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5de651c5-4e9e-4415-bd4d-42af8a652607 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:30.287203 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5de651c5-4e9e-4415-bd4d-42af8a652607 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b" status: 200 len: 1372 microversion: 2.1 time: 0.190974 Jun 16 12:29:30.287896 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 200/396] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:30 2022] GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b => generated 1372 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:29:30.559307 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-33a7c008-39b1-464a-9277-85775249f11e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:30.559945 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-33a7c008-39b1-464a-9277-85775249f11e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:30.565944 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-33a7c008-39b1-464a-9277-85775249f11e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:30.566400 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-33a7c008-39b1-464a-9277-85775249f11e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:30.567165 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-33a7c008-39b1-464a-9277-85775249f11e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:30.567604 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-33a7c008-39b1-464a-9277-85775249f11e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:30.615750 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-298fc371-8021-4c98-9c69-177b4046b4ce tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Flavor limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 12:29:30.616710 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-298fc371-8021-4c98-9c69-177b4046b4ce tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Image limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 12:29:30.617192 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-298fc371-8021-4c98-9c69-177b4046b4ce tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Flavor pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 12:29:30.617667 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-298fc371-8021-4c98-9c69-177b4046b4ce tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Image pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 12:29:30.618221 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-298fc371-8021-4c98-9c69-177b4046b4ce tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 12:29:30.627867 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-298fc371-8021-4c98-9c69-177b4046b4ce tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:30.628261 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-298fc371-8021-4c98-9c69-177b4046b4ce tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:30.629062 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-298fc371-8021-4c98-9c69-177b4046b4ce tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:30.629500 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-298fc371-8021-4c98-9c69-177b4046b4ce tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:30.646345 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-298fc371-8021-4c98-9c69-177b4046b4ce tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Getting quotas for project 10da9307eea6448ca287f557b450e3f4. Resources: {'instances', 'cores', 'ram'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 12:29:30.650368 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-298fc371-8021-4c98-9c69-177b4046b4ce tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Getting quotas for user 03828f516fce48d7b00b7027f6848190 and project 10da9307eea6448ca287f557b450e3f4. Resources: {'instances', 'cores', 'ram'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 12:29:30.661777 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-298fc371-8021-4c98-9c69-177b4046b4ce tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Going to run 1 instances... {{(pid=117606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 12:29:30.664071 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-298fc371-8021-4c98-9c69-177b4046b4ce tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] [instance: 8b4082a7-fb3e-463c-840f-0d1eab71722a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c736a2d2-9d0d-41ec-b9fc-971428b0ff7a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 12:29:30.706074 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-33a7c008-39b1-464a-9277-85775249f11e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:30.712134 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-298fc371-8021-4c98-9c69-177b4046b4ce tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.535280 Jun 16 12:29:30.712783 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 197/397] 10.222.0.45 () {60 vars in 1146 bytes} [Thu Jun 16 12:29:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 537 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 12:29:30.719700 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-33a7c008-39b1-464a-9277-85775249f11e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:30.721374 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-33a7c008-39b1-464a-9277-85775249f11e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:30.722617 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-33a7c008-39b1-464a-9277-85775249f11e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1721 microversion: 2.20 time: 0.168012 Jun 16 12:29:30.722900 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b3779ae9-c460-434d-a2e6-16dfcb39035a tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:30.723548 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b3779ae9-c460-434d-a2e6-16dfcb39035a tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] [instance: 8b4082a7-fb3e-463c-840f-0d1eab71722a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:30.730962 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 201/398] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:29:30 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 12:29:30.789084 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b3779ae9-c460-434d-a2e6-16dfcb39035a tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03828f516fce48d7b00b7027f6848190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10da9307eea6448ca287f557b450e3f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:30.796331 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b3779ae9-c460-434d-a2e6-16dfcb39035a tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] 10.222.0.45 "GET /compute/v2.1/servers/8b4082a7-fb3e-463c-840f-0d1eab71722a" status: 200 len: 1214 microversion: 2.1 time: 0.077638 Jun 16 12:29:30.796895 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 198/399] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:30 2022] GET /compute/v2.1/servers/8b4082a7-fb3e-463c-840f-0d1eab71722a => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:29:31.304823 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0dcbac3b-c1de-4e73-943c-497e665f293b tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:31.305457 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0dcbac3b-c1de-4e73-943c-497e665f293b tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c2472931-f1a1-4aec-963a-63a7495b733b] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:31.311966 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0dcbac3b-c1de-4e73-943c-497e665f293b tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:31.312419 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0dcbac3b-c1de-4e73-943c-497e665f293b tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:31.313183 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0dcbac3b-c1de-4e73-943c-497e665f293b tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:31.313631 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0dcbac3b-c1de-4e73-943c-497e665f293b tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:31.446746 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0dcbac3b-c1de-4e73-943c-497e665f293b tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:31.455430 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0dcbac3b-c1de-4e73-943c-497e665f293b tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b" status: 200 len: 1372 microversion: 2.1 time: 0.154380 Jun 16 12:29:31.456121 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 202/400] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:31 2022] GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:29:31.742456 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ad4a9232-61c7-4e55-ad1e-09b73f78206c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:31.743066 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ad4a9232-61c7-4e55-ad1e-09b73f78206c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:31.750603 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ad4a9232-61c7-4e55-ad1e-09b73f78206c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:31.751088 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ad4a9232-61c7-4e55-ad1e-09b73f78206c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:31.751892 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ad4a9232-61c7-4e55-ad1e-09b73f78206c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:31.752316 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ad4a9232-61c7-4e55-ad1e-09b73f78206c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:31.813795 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-fda9488f-eb80-41d2-a9f7-56ed9a8fb017 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:31.814801 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-fda9488f-eb80-41d2-a9f7-56ed9a8fb017 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] [instance: 8b4082a7-fb3e-463c-840f-0d1eab71722a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:31.822865 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fda9488f-eb80-41d2-a9f7-56ed9a8fb017 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:31.824268 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fda9488f-eb80-41d2-a9f7-56ed9a8fb017 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:31.825192 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fda9488f-eb80-41d2-a9f7-56ed9a8fb017 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:31.825702 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fda9488f-eb80-41d2-a9f7-56ed9a8fb017 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:31.900633 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-fda9488f-eb80-41d2-a9f7-56ed9a8fb017 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03828f516fce48d7b00b7027f6848190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10da9307eea6448ca287f557b450e3f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:31.913620 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-fda9488f-eb80-41d2-a9f7-56ed9a8fb017 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] 10.222.0.45 "GET /compute/v2.1/servers/8b4082a7-fb3e-463c-840f-0d1eab71722a" status: 200 len: 1274 microversion: 2.1 time: 0.103834 Jun 16 12:29:31.914357 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 203/401] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:31 2022] GET /compute/v2.1/servers/8b4082a7-fb3e-463c-840f-0d1eab71722a => generated 1274 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:29:31.930625 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ad4a9232-61c7-4e55-ad1e-09b73f78206c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:31.940602 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ad4a9232-61c7-4e55-ad1e-09b73f78206c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:31.942451 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ad4a9232-61c7-4e55-ad1e-09b73f78206c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:31.943626 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ad4a9232-61c7-4e55-ad1e-09b73f78206c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1721 microversion: 2.20 time: 0.205512 Jun 16 12:29:31.944177 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 199/402] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:29:31 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1721 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:29:32.428364 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-473444aa-87f3-4938-b189-588d848edec3 req-41793488-d04b-4670-9fb8-99f4151cfccd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2472931-f1a1-4aec-963a-63a7495b733b", "name": "network-vif-plugged", "status": "completed", "tag": "2aacd7af-3e65-4a78-9162-adc1a6afdbc1"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:29:32.438623 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-473444aa-87f3-4938-b189-588d848edec3 req-41793488-d04b-4670-9fb8-99f4151cfccd service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:32.439168 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-473444aa-87f3-4938-b189-588d848edec3 req-41793488-d04b-4670-9fb8-99f4151cfccd service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:32.453749 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-473444aa-87f3-4938-b189-588d848edec3 req-41793488-d04b-4670-9fb8-99f4151cfccd service nova] Creating event network-vif-plugged:2aacd7af-3e65-4a78-9162-adc1a6afdbc1 for instance c2472931-f1a1-4aec-963a-63a7495b733b on hv-cinder-84614 Jun 16 12:29:32.458716 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-473444aa-87f3-4938-b189-588d848edec3 req-41793488-d04b-4670-9fb8-99f4151cfccd service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034091 Jun 16 12:29:32.459613 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 204/403] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:29:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:29:32.472778 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a30ff38e-881f-4392-99b5-e1b8566b43f3 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:32.473599 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a30ff38e-881f-4392-99b5-e1b8566b43f3 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c2472931-f1a1-4aec-963a-63a7495b733b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:32.480041 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a30ff38e-881f-4392-99b5-e1b8566b43f3 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:32.480574 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a30ff38e-881f-4392-99b5-e1b8566b43f3 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:32.481420 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a30ff38e-881f-4392-99b5-e1b8566b43f3 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:32.481956 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a30ff38e-881f-4392-99b5-e1b8566b43f3 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:32.640598 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a30ff38e-881f-4392-99b5-e1b8566b43f3 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:32.648350 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a30ff38e-881f-4392-99b5-e1b8566b43f3 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b" status: 200 len: 1372 microversion: 2.1 time: 0.179544 Jun 16 12:29:32.648936 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 200/404] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:32 2022] GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b => generated 1372 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:29:32.931533 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-81f59151-b0ab-4915-840e-c6d63a4e99b7 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:32.932396 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-81f59151-b0ab-4915-840e-c6d63a4e99b7 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] [instance: 8b4082a7-fb3e-463c-840f-0d1eab71722a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:32.939171 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-81f59151-b0ab-4915-840e-c6d63a4e99b7 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:32.939618 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-81f59151-b0ab-4915-840e-c6d63a4e99b7 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:32.940383 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-81f59151-b0ab-4915-840e-c6d63a4e99b7 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:32.940826 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-81f59151-b0ab-4915-840e-c6d63a4e99b7 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:32.968641 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-cf81d280-3ecb-4b0b-b691-16570a5c2f07 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:32.969945 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-cf81d280-3ecb-4b0b-b691-16570a5c2f07 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:32.982227 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cf81d280-3ecb-4b0b-b691-16570a5c2f07 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:32.983738 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cf81d280-3ecb-4b0b-b691-16570a5c2f07 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:32.985251 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cf81d280-3ecb-4b0b-b691-16570a5c2f07 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:32.986219 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cf81d280-3ecb-4b0b-b691-16570a5c2f07 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:33.134981 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-81f59151-b0ab-4915-840e-c6d63a4e99b7 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03828f516fce48d7b00b7027f6848190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10da9307eea6448ca287f557b450e3f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:33.146474 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-81f59151-b0ab-4915-840e-c6d63a4e99b7 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] 10.222.0.45 "GET /compute/v2.1/servers/8b4082a7-fb3e-463c-840f-0d1eab71722a" status: 200 len: 1314 microversion: 2.1 time: 0.219111 Jun 16 12:29:33.147367 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 205/405] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:32 2022] GET /compute/v2.1/servers/8b4082a7-fb3e-463c-840f-0d1eab71722a => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:29:33.193772 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-cf81d280-3ecb-4b0b-b691-16570a5c2f07 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:33.204205 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-cf81d280-3ecb-4b0b-b691-16570a5c2f07 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:33.205791 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-cf81d280-3ecb-4b0b-b691-16570a5c2f07 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:33.208202 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-cf81d280-3ecb-4b0b-b691-16570a5c2f07 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1721 microversion: 2.20 time: 0.247344 Jun 16 12:29:33.208923 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 201/406] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:29:32 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1721 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:29:33.362446 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-eca7d978-a99a-48f9-b114-6962176d91a5 req-5df976e8-c5c9-40bf-8c98-a0f87b40bcce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b4082a7-fb3e-463c-840f-0d1eab71722a", "tag": "180f3290-6a2a-4814-9ead-30389a941d4e"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:29:33.371471 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-eca7d978-a99a-48f9-b114-6962176d91a5 req-5df976e8-c5c9-40bf-8c98-a0f87b40bcce service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:33.372132 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-eca7d978-a99a-48f9-b114-6962176d91a5 req-5df976e8-c5c9-40bf-8c98-a0f87b40bcce service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:33.383893 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-eca7d978-a99a-48f9-b114-6962176d91a5 req-5df976e8-c5c9-40bf-8c98-a0f87b40bcce service nova] Creating event network-changed:180f3290-6a2a-4814-9ead-30389a941d4e for instance 8b4082a7-fb3e-463c-840f-0d1eab71722a on hv-cinder-84614 Jun 16 12:29:33.389034 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-eca7d978-a99a-48f9-b114-6962176d91a5 req-5df976e8-c5c9-40bf-8c98-a0f87b40bcce service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035879 Jun 16 12:29:33.389714 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 206/407] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:29:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 12:29:33.667540 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-bb93421f-d42a-45f6-8925-7ab81231af14 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:33.668139 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-bb93421f-d42a-45f6-8925-7ab81231af14 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c2472931-f1a1-4aec-963a-63a7495b733b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:33.674759 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bb93421f-d42a-45f6-8925-7ab81231af14 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:33.675224 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bb93421f-d42a-45f6-8925-7ab81231af14 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:33.675972 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bb93421f-d42a-45f6-8925-7ab81231af14 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:33.676402 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bb93421f-d42a-45f6-8925-7ab81231af14 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:33.811266 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-bb93421f-d42a-45f6-8925-7ab81231af14 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:33.818844 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-bb93421f-d42a-45f6-8925-7ab81231af14 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b" status: 200 len: 1372 microversion: 2.1 time: 0.156283 Jun 16 12:29:33.819406 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 202/408] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:33 2022] GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:29:34.162120 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell0:SELECT=2 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:29:34.167910 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-daf16b96-9a26-49c3-9523-2768a736b7ec tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:34.168799 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-daf16b96-9a26-49c3-9523-2768a736b7ec tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] [instance: 8b4082a7-fb3e-463c-840f-0d1eab71722a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:34.175621 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-daf16b96-9a26-49c3-9523-2768a736b7ec tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:34.176072 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-daf16b96-9a26-49c3-9523-2768a736b7ec tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:34.176870 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-daf16b96-9a26-49c3-9523-2768a736b7ec tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:34.177306 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-daf16b96-9a26-49c3-9523-2768a736b7ec tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:34.230290 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-eb20b23b-5377-4e4a-94c3-8e5bad31c69a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:34.230881 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-eb20b23b-5377-4e4a-94c3-8e5bad31c69a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:34.238441 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eb20b23b-5377-4e4a-94c3-8e5bad31c69a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:34.239013 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eb20b23b-5377-4e4a-94c3-8e5bad31c69a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:34.239968 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eb20b23b-5377-4e4a-94c3-8e5bad31c69a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:34.240401 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eb20b23b-5377-4e4a-94c3-8e5bad31c69a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:34.397511 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-daf16b96-9a26-49c3-9523-2768a736b7ec tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03828f516fce48d7b00b7027f6848190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10da9307eea6448ca287f557b450e3f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:34.407942 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-daf16b96-9a26-49c3-9523-2768a736b7ec tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] 10.222.0.45 "GET /compute/v2.1/servers/8b4082a7-fb3e-463c-840f-0d1eab71722a" status: 200 len: 1314 microversion: 2.1 time: 0.247039 Jun 16 12:29:34.409010 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 207/409] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:34 2022] GET /compute/v2.1/servers/8b4082a7-fb3e-463c-840f-0d1eab71722a => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:29:34.444240 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-eb20b23b-5377-4e4a-94c3-8e5bad31c69a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:34.452849 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-eb20b23b-5377-4e4a-94c3-8e5bad31c69a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:34.454321 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-eb20b23b-5377-4e4a-94c3-8e5bad31c69a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:34.455511 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-eb20b23b-5377-4e4a-94c3-8e5bad31c69a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1721 microversion: 2.20 time: 0.231255 Jun 16 12:29:34.456082 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 203/410] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:29:34 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1721 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:29:34.836489 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f872df38-5e36-4836-b4ae-3d186179664c tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:34.837006 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f872df38-5e36-4836-b4ae-3d186179664c tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c2472931-f1a1-4aec-963a-63a7495b733b] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:34.844169 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f872df38-5e36-4836-b4ae-3d186179664c tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:34.844613 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f872df38-5e36-4836-b4ae-3d186179664c tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:34.845365 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f872df38-5e36-4836-b4ae-3d186179664c tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:34.845799 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f872df38-5e36-4836-b4ae-3d186179664c tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:34.977771 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f872df38-5e36-4836-b4ae-3d186179664c tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:34.986301 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f872df38-5e36-4836-b4ae-3d186179664c tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b" status: 200 len: 1567 microversion: 2.1 time: 0.153701 Jun 16 12:29:34.986873 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 208/411] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:34 2022] GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:29:35.002671 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c8df6108-9e1f-44ec-902a-274dda08d69b tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:35.003167 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c8df6108-9e1f-44ec-902a-274dda08d69b tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c2472931-f1a1-4aec-963a-63a7495b733b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:35.009210 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c8df6108-9e1f-44ec-902a-274dda08d69b tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:35.009660 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c8df6108-9e1f-44ec-902a-274dda08d69b tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:35.011020 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c8df6108-9e1f-44ec-902a-274dda08d69b tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:35.011604 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c8df6108-9e1f-44ec-902a-274dda08d69b tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:35.089706 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c8df6108-9e1f-44ec-902a-274dda08d69b tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090842 Jun 16 12:29:35.090339 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 204/412] 10.222.0.45 () {58 vars in 1274 bytes} [Thu Jun 16 12:29:34 2022] GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:29:35.427481 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-08627fa8-b6e9-485e-abe1-be5932de0e57 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:35.428455 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-08627fa8-b6e9-485e-abe1-be5932de0e57 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] [instance: 8b4082a7-fb3e-463c-840f-0d1eab71722a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:35.431090 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:29:35.437405 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-08627fa8-b6e9-485e-abe1-be5932de0e57 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:35.438088 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-08627fa8-b6e9-485e-abe1-be5932de0e57 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:35.438933 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-08627fa8-b6e9-485e-abe1-be5932de0e57 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:35.439468 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-08627fa8-b6e9-485e-abe1-be5932de0e57 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:35.474522 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d3eddfaa-e1dd-4937-b6fb-05b011f4075a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:35.475127 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d3eddfaa-e1dd-4937-b6fb-05b011f4075a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:35.481335 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d3eddfaa-e1dd-4937-b6fb-05b011f4075a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:35.481882 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d3eddfaa-e1dd-4937-b6fb-05b011f4075a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:35.482680 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d3eddfaa-e1dd-4937-b6fb-05b011f4075a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:35.483275 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d3eddfaa-e1dd-4937-b6fb-05b011f4075a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:35.634150 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-08627fa8-b6e9-485e-abe1-be5932de0e57 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03828f516fce48d7b00b7027f6848190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10da9307eea6448ca287f557b450e3f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:35.636994 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:29:35.644623 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-08627fa8-b6e9-485e-abe1-be5932de0e57 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] 10.222.0.45 "GET /compute/v2.1/servers/8b4082a7-fb3e-463c-840f-0d1eab71722a" status: 200 len: 1314 microversion: 2.1 time: 0.222213 Jun 16 12:29:35.645437 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 209/413] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:35 2022] GET /compute/v2.1/servers/8b4082a7-fb3e-463c-840f-0d1eab71722a => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:29:35.670748 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d3eddfaa-e1dd-4937-b6fb-05b011f4075a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:35.679178 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d3eddfaa-e1dd-4937-b6fb-05b011f4075a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:35.680687 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d3eddfaa-e1dd-4937-b6fb-05b011f4075a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:35.681842 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d3eddfaa-e1dd-4937-b6fb-05b011f4075a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1721 microversion: 2.20 time: 0.211649 Jun 16 12:29:35.682669 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 205/414] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:29:35 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1721 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:29:36.192587 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-6df33ba7-29be-436c-b5fe-806d7c86f7a1 req-55d39307-2a46-44b8-ace9-c751b5b5ff77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2472931-f1a1-4aec-963a-63a7495b733b", "tag": "2aacd7af-3e65-4a78-9162-adc1a6afdbc1"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:29:36.203114 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-6df33ba7-29be-436c-b5fe-806d7c86f7a1 req-55d39307-2a46-44b8-ace9-c751b5b5ff77 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:36.203621 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-6df33ba7-29be-436c-b5fe-806d7c86f7a1 req-55d39307-2a46-44b8-ace9-c751b5b5ff77 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:36.217494 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-6df33ba7-29be-436c-b5fe-806d7c86f7a1 req-55d39307-2a46-44b8-ace9-c751b5b5ff77 service nova] Creating event network-changed:2aacd7af-3e65-4a78-9162-adc1a6afdbc1 for instance c2472931-f1a1-4aec-963a-63a7495b733b on hv-cinder-84614 Jun 16 12:29:36.222931 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-6df33ba7-29be-436c-b5fe-806d7c86f7a1 req-55d39307-2a46-44b8-ace9-c751b5b5ff77 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034119 Jun 16 12:29:36.223551 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 210/415] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:29:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:29:36.662275 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-63288d50-1e36-4a1f-b5da-8262c8da50b9 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:36.662885 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-63288d50-1e36-4a1f-b5da-8262c8da50b9 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] [instance: 8b4082a7-fb3e-463c-840f-0d1eab71722a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:36.670551 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-63288d50-1e36-4a1f-b5da-8262c8da50b9 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:36.670995 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-63288d50-1e36-4a1f-b5da-8262c8da50b9 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:36.671756 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-63288d50-1e36-4a1f-b5da-8262c8da50b9 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:36.672188 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-63288d50-1e36-4a1f-b5da-8262c8da50b9 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:36.701522 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6fad55ee-d21e-4dcd-bf8e-b41dfc7f62d3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:36.702678 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6fad55ee-d21e-4dcd-bf8e-b41dfc7f62d3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:36.727489 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6fad55ee-d21e-4dcd-bf8e-b41dfc7f62d3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:36.728293 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6fad55ee-d21e-4dcd-bf8e-b41dfc7f62d3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:36.729937 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6fad55ee-d21e-4dcd-bf8e-b41dfc7f62d3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:36.730827 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6fad55ee-d21e-4dcd-bf8e-b41dfc7f62d3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:36.873515 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-63288d50-1e36-4a1f-b5da-8262c8da50b9 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03828f516fce48d7b00b7027f6848190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10da9307eea6448ca287f557b450e3f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:36.883086 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-63288d50-1e36-4a1f-b5da-8262c8da50b9 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] 10.222.0.45 "GET /compute/v2.1/servers/8b4082a7-fb3e-463c-840f-0d1eab71722a" status: 200 len: 1314 microversion: 2.1 time: 0.224901 Jun 16 12:29:36.892525 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 206/416] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:36 2022] GET /compute/v2.1/servers/8b4082a7-fb3e-463c-840f-0d1eab71722a => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:29:36.905573 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6fad55ee-d21e-4dcd-bf8e-b41dfc7f62d3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:36.914197 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6fad55ee-d21e-4dcd-bf8e-b41dfc7f62d3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:36.915885 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6fad55ee-d21e-4dcd-bf8e-b41dfc7f62d3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:36.917849 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6fad55ee-d21e-4dcd-bf8e-b41dfc7f62d3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1721 microversion: 2.20 time: 0.220583 Jun 16 12:29:36.918645 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 211/417] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:29:36 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1721 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:29:37.899766 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-bccf1e2a-64c3-44d7-a35b-b0dc1a74556b tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:37.900373 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-bccf1e2a-64c3-44d7-a35b-b0dc1a74556b tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] [instance: 8b4082a7-fb3e-463c-840f-0d1eab71722a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:37.907967 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bccf1e2a-64c3-44d7-a35b-b0dc1a74556b tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:37.908422 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bccf1e2a-64c3-44d7-a35b-b0dc1a74556b tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:37.909454 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bccf1e2a-64c3-44d7-a35b-b0dc1a74556b tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:37.910006 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bccf1e2a-64c3-44d7-a35b-b0dc1a74556b tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:37.936495 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2d460ee4-b837-4666-bca4-b74efc3635c6 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:37.937109 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2d460ee4-b837-4666-bca4-b74efc3635c6 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:37.943625 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2d460ee4-b837-4666-bca4-b74efc3635c6 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:37.944069 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2d460ee4-b837-4666-bca4-b74efc3635c6 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:37.944836 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2d460ee4-b837-4666-bca4-b74efc3635c6 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:37.945269 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2d460ee4-b837-4666-bca4-b74efc3635c6 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:38.318778 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-bccf1e2a-64c3-44d7-a35b-b0dc1a74556b tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03828f516fce48d7b00b7027f6848190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10da9307eea6448ca287f557b450e3f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:38.326264 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-bccf1e2a-64c3-44d7-a35b-b0dc1a74556b tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] 10.222.0.45 "GET /compute/v2.1/servers/8b4082a7-fb3e-463c-840f-0d1eab71722a" status: 200 len: 1314 microversion: 2.1 time: 0.430262 Jun 16 12:29:38.326839 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 207/418] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:37 2022] GET /compute/v2.1/servers/8b4082a7-fb3e-463c-840f-0d1eab71722a => generated 1314 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:29:38.345250 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2d460ee4-b837-4666-bca4-b74efc3635c6 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:38.353379 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2d460ee4-b837-4666-bca4-b74efc3635c6 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:38.356103 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2d460ee4-b837-4666-bca4-b74efc3635c6 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:38.358523 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2d460ee4-b837-4666-bca4-b74efc3635c6 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1721 microversion: 2.20 time: 0.425862 Jun 16 12:29:38.359129 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 212/419] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:29:37 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1721 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 12:29:39.344142 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9d317e6a-6a0d-44d3-ae09-23b10ef96ff6 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:39.344746 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9d317e6a-6a0d-44d3-ae09-23b10ef96ff6 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] [instance: 8b4082a7-fb3e-463c-840f-0d1eab71722a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:39.351204 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9d317e6a-6a0d-44d3-ae09-23b10ef96ff6 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:39.351644 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9d317e6a-6a0d-44d3-ae09-23b10ef96ff6 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:39.352390 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9d317e6a-6a0d-44d3-ae09-23b10ef96ff6 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:39.352840 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9d317e6a-6a0d-44d3-ae09-23b10ef96ff6 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:39.376447 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f2320c39-f828-49c5-9279-eb68202efcd8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:39.377057 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f2320c39-f828-49c5-9279-eb68202efcd8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:39.383524 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f2320c39-f828-49c5-9279-eb68202efcd8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:39.383977 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f2320c39-f828-49c5-9279-eb68202efcd8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:39.384766 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f2320c39-f828-49c5-9279-eb68202efcd8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:39.385250 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f2320c39-f828-49c5-9279-eb68202efcd8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:39.543711 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9d317e6a-6a0d-44d3-ae09-23b10ef96ff6 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03828f516fce48d7b00b7027f6848190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10da9307eea6448ca287f557b450e3f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:39.552672 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9d317e6a-6a0d-44d3-ae09-23b10ef96ff6 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] 10.222.0.45 "GET /compute/v2.1/servers/8b4082a7-fb3e-463c-840f-0d1eab71722a" status: 200 len: 1314 microversion: 2.1 time: 0.212271 Jun 16 12:29:39.553233 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 208/420] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:39 2022] GET /compute/v2.1/servers/8b4082a7-fb3e-463c-840f-0d1eab71722a => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:29:39.580572 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f2320c39-f828-49c5-9279-eb68202efcd8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:39.589112 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f2320c39-f828-49c5-9279-eb68202efcd8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:39.590645 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f2320c39-f828-49c5-9279-eb68202efcd8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:39.591793 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f2320c39-f828-49c5-9279-eb68202efcd8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1721 microversion: 2.20 time: 0.219179 Jun 16 12:29:39.592337 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 213/421] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:29:39 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1721 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 12:29:40.568226 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2b8b24f0-3ae9-4b4c-adbf-eae29f0c30bd tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:40.568840 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2b8b24f0-3ae9-4b4c-adbf-eae29f0c30bd tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] [instance: 8b4082a7-fb3e-463c-840f-0d1eab71722a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:40.575543 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2b8b24f0-3ae9-4b4c-adbf-eae29f0c30bd tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:40.575986 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2b8b24f0-3ae9-4b4c-adbf-eae29f0c30bd tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:40.576749 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2b8b24f0-3ae9-4b4c-adbf-eae29f0c30bd tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:40.577182 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2b8b24f0-3ae9-4b4c-adbf-eae29f0c30bd tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:40.610409 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-805979d5-8662-4398-9f6a-46968ee56e17 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:40.611045 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-805979d5-8662-4398-9f6a-46968ee56e17 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:40.617578 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-805979d5-8662-4398-9f6a-46968ee56e17 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:40.618075 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-805979d5-8662-4398-9f6a-46968ee56e17 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:40.618848 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-805979d5-8662-4398-9f6a-46968ee56e17 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:40.619286 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-805979d5-8662-4398-9f6a-46968ee56e17 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:40.637023 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=2 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:29:40.761166 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2b8b24f0-3ae9-4b4c-adbf-eae29f0c30bd tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03828f516fce48d7b00b7027f6848190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10da9307eea6448ca287f557b450e3f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:40.768662 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2b8b24f0-3ae9-4b4c-adbf-eae29f0c30bd tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] 10.222.0.45 "GET /compute/v2.1/servers/8b4082a7-fb3e-463c-840f-0d1eab71722a" status: 200 len: 1314 microversion: 2.1 time: 0.204183 Jun 16 12:29:40.772197 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 209/422] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:40 2022] GET /compute/v2.1/servers/8b4082a7-fb3e-463c-840f-0d1eab71722a => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:29:40.792637 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-805979d5-8662-4398-9f6a-46968ee56e17 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:40.800386 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-805979d5-8662-4398-9f6a-46968ee56e17 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:40.801948 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-805979d5-8662-4398-9f6a-46968ee56e17 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:40.803092 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-805979d5-8662-4398-9f6a-46968ee56e17 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1721 microversion: 2.20 time: 0.196515 Jun 16 12:29:40.803640 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 214/423] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:29:40 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1721 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:29:41.771349 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-dd683ca7-aac4-46fc-b0e9-0d9ebc9971e8 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:41.772613 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-dd683ca7-aac4-46fc-b0e9-0d9ebc9971e8 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] [instance: 17f61c67-8ad3-49b1-9efa-045274e693b2] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:41.776187 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=8 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:29:41.777428 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:29:41.781127 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dd683ca7-aac4-46fc-b0e9-0d9ebc9971e8 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:41.781785 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dd683ca7-aac4-46fc-b0e9-0d9ebc9971e8 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:41.782753 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dd683ca7-aac4-46fc-b0e9-0d9ebc9971e8 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:41.783360 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dd683ca7-aac4-46fc-b0e9-0d9ebc9971e8 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:41.786748 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c32ebaec-b234-4582-a7f2-a0b0641e442a tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:41.787428 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c32ebaec-b234-4582-a7f2-a0b0641e442a tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] [instance: 8b4082a7-fb3e-463c-840f-0d1eab71722a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:41.796146 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c32ebaec-b234-4582-a7f2-a0b0641e442a tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:41.796943 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c32ebaec-b234-4582-a7f2-a0b0641e442a tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:41.797813 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c32ebaec-b234-4582-a7f2-a0b0641e442a tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:41.798360 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c32ebaec-b234-4582-a7f2-a0b0641e442a tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:42.037739 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-dd683ca7-aac4-46fc-b0e9-0d9ebc9971e8 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e645784fea14d4785df3eefabf77383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01904f10607d4b4bb91b807bff7ba8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:42.042983 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c32ebaec-b234-4582-a7f2-a0b0641e442a tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03828f516fce48d7b00b7027f6848190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10da9307eea6448ca287f557b450e3f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:42.052115 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-dd683ca7-aac4-46fc-b0e9-0d9ebc9971e8 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] 10.222.0.45 "GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2" status: 200 len: 1594 microversion: 2.1 time: 0.284669 Jun 16 12:29:42.052791 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 210/424] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:41 2022] GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2 => generated 1594 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:29:42.054979 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c32ebaec-b234-4582-a7f2-a0b0641e442a tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] 10.222.0.45 "GET /compute/v2.1/servers/8b4082a7-fb3e-463c-840f-0d1eab71722a" status: 200 len: 1314 microversion: 2.1 time: 0.272376 Jun 16 12:29:42.055754 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 215/425] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:41 2022] GET /compute/v2.1/servers/8b4082a7-fb3e-463c-840f-0d1eab71722a => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:29:42.058712 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-545fe5cc-99f0-4264-8c9b-c20fa50e9481 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:42.059404 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-545fe5cc-99f0-4264-8c9b-c20fa50e9481 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:42.065468 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-545fe5cc-99f0-4264-8c9b-c20fa50e9481 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:42.066019 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-545fe5cc-99f0-4264-8c9b-c20fa50e9481 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:42.067075 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-545fe5cc-99f0-4264-8c9b-c20fa50e9481 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:42.067581 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-545fe5cc-99f0-4264-8c9b-c20fa50e9481 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:42.241698 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-545fe5cc-99f0-4264-8c9b-c20fa50e9481 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:42.250522 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-545fe5cc-99f0-4264-8c9b-c20fa50e9481 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:42.252011 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-545fe5cc-99f0-4264-8c9b-c20fa50e9481 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:42.253194 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-545fe5cc-99f0-4264-8c9b-c20fa50e9481 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1742 microversion: 2.20 time: 0.199290 Jun 16 12:29:42.253744 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 211/426] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:29:42 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1742 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:29:43.080032 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e28c49e4-3189-4790-8615-3fece3a5a079 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:43.080648 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e28c49e4-3189-4790-8615-3fece3a5a079 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] [instance: 8b4082a7-fb3e-463c-840f-0d1eab71722a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:43.087057 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e28c49e4-3189-4790-8615-3fece3a5a079 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:43.087488 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e28c49e4-3189-4790-8615-3fece3a5a079 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:43.088283 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e28c49e4-3189-4790-8615-3fece3a5a079 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:43.089349 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e28c49e4-3189-4790-8615-3fece3a5a079 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:43.227218 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e28c49e4-3189-4790-8615-3fece3a5a079 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03828f516fce48d7b00b7027f6848190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10da9307eea6448ca287f557b450e3f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:43.234859 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e28c49e4-3189-4790-8615-3fece3a5a079 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] 10.222.0.45 "GET /compute/v2.1/servers/8b4082a7-fb3e-463c-840f-0d1eab71722a" status: 200 len: 1314 microversion: 2.1 time: 0.158553 Jun 16 12:29:43.235427 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 216/427] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:43 2022] GET /compute/v2.1/servers/8b4082a7-fb3e-463c-840f-0d1eab71722a => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:29:43.274203 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fff4cc33-499d-4aaa-9f46-dfe5279f3e3b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:43.274812 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-fff4cc33-499d-4aaa-9f46-dfe5279f3e3b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:43.281997 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fff4cc33-499d-4aaa-9f46-dfe5279f3e3b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:43.282457 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fff4cc33-499d-4aaa-9f46-dfe5279f3e3b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:43.283216 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fff4cc33-499d-4aaa-9f46-dfe5279f3e3b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:43.283652 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fff4cc33-499d-4aaa-9f46-dfe5279f3e3b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:43.414620 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fff4cc33-499d-4aaa-9f46-dfe5279f3e3b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:43.423141 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fff4cc33-499d-4aaa-9f46-dfe5279f3e3b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:43.424757 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fff4cc33-499d-4aaa-9f46-dfe5279f3e3b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:43.426045 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-fff4cc33-499d-4aaa-9f46-dfe5279f3e3b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1742 microversion: 2.20 time: 0.157516 Jun 16 12:29:43.426880 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 212/428] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:29:43 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1742 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:29:43.975350 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-ea327a98-90c1-4ce3-ad2d-2921cdc8cac1 req-45a9f3ea-9343-486c-84f4-ce5307358671 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b4082a7-fb3e-463c-840f-0d1eab71722a", "name": "network-vif-plugged", "status": "completed", "tag": "180f3290-6a2a-4814-9ead-30389a941d4e"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:29:43.984913 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-ea327a98-90c1-4ce3-ad2d-2921cdc8cac1 req-45a9f3ea-9343-486c-84f4-ce5307358671 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:43.985432 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-ea327a98-90c1-4ce3-ad2d-2921cdc8cac1 req-45a9f3ea-9343-486c-84f4-ce5307358671 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:44.001733 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-ea327a98-90c1-4ce3-ad2d-2921cdc8cac1 req-45a9f3ea-9343-486c-84f4-ce5307358671 service nova] Creating event network-vif-plugged:180f3290-6a2a-4814-9ead-30389a941d4e for instance 8b4082a7-fb3e-463c-840f-0d1eab71722a on hv-cinder-84614 Jun 16 12:29:44.006745 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-ea327a98-90c1-4ce3-ad2d-2921cdc8cac1 req-45a9f3ea-9343-486c-84f4-ce5307358671 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035190 Jun 16 12:29:44.008199 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 217/429] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:29:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:29:44.177820 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-e8a0ffb7-cfde-43b9-b808-026a25a59ba1 req-eb071381-cd0d-41eb-bfe9-1d5353774dc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17f61c67-8ad3-49b1-9efa-045274e693b2", "tag": "49fea4da-1208-4fe6-931a-6a66f0c864cf"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:29:44.194498 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-e8a0ffb7-cfde-43b9-b808-026a25a59ba1 req-eb071381-cd0d-41eb-bfe9-1d5353774dc8 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:44.195305 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-e8a0ffb7-cfde-43b9-b808-026a25a59ba1 req-eb071381-cd0d-41eb-bfe9-1d5353774dc8 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:44.211203 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-e8a0ffb7-cfde-43b9-b808-026a25a59ba1 req-eb071381-cd0d-41eb-bfe9-1d5353774dc8 service nova] Creating event network-changed:49fea4da-1208-4fe6-931a-6a66f0c864cf for instance 17f61c67-8ad3-49b1-9efa-045274e693b2 on hv-cinder-84614 Jun 16 12:29:44.218894 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-e8a0ffb7-cfde-43b9-b808-026a25a59ba1 req-eb071381-cd0d-41eb-bfe9-1d5353774dc8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044312 Jun 16 12:29:44.219718 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 213/430] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:29:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:29:44.253898 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-52229e04-7f07-4578-ae6f-c5856729595e tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:44.256354 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-52229e04-7f07-4578-ae6f-c5856729595e tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] [instance: 8b4082a7-fb3e-463c-840f-0d1eab71722a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:44.263445 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-52229e04-7f07-4578-ae6f-c5856729595e tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:44.264411 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-52229e04-7f07-4578-ae6f-c5856729595e tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:44.266307 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-52229e04-7f07-4578-ae6f-c5856729595e tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:44.267019 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-52229e04-7f07-4578-ae6f-c5856729595e tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:44.446197 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6fce9600-8631-496e-a57a-7e236857c645 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:44.446918 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6fce9600-8631-496e-a57a-7e236857c645 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:44.457541 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6fce9600-8631-496e-a57a-7e236857c645 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:44.458028 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6fce9600-8631-496e-a57a-7e236857c645 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:44.459062 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6fce9600-8631-496e-a57a-7e236857c645 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:44.459693 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6fce9600-8631-496e-a57a-7e236857c645 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:44.488895 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:29:44.512189 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-52229e04-7f07-4578-ae6f-c5856729595e tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03828f516fce48d7b00b7027f6848190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10da9307eea6448ca287f557b450e3f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:44.522187 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-52229e04-7f07-4578-ae6f-c5856729595e tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] 10.222.0.45 "GET /compute/v2.1/servers/8b4082a7-fb3e-463c-840f-0d1eab71722a" status: 200 len: 1314 microversion: 2.1 time: 0.273940 Jun 16 12:29:44.533109 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 218/431] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:44 2022] GET /compute/v2.1/servers/8b4082a7-fb3e-463c-840f-0d1eab71722a => generated 1314 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:29:44.560313 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2738a468-8ef0-4a53-9383-23523750fb19 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:44.561624 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2738a468-8ef0-4a53-9383-23523750fb19 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: ddba5ba6-d9f4-493c-b15b-9443a5426682] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:44.568087 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2738a468-8ef0-4a53-9383-23523750fb19 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:44.568805 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2738a468-8ef0-4a53-9383-23523750fb19 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:44.569794 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2738a468-8ef0-4a53-9383-23523750fb19 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:44.570780 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2738a468-8ef0-4a53-9383-23523750fb19 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:44.605104 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2738a468-8ef0-4a53-9383-23523750fb19 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682/ips" status: 200 len: 151 microversion: 2.1 time: 0.049531 Jun 16 12:29:44.606379 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 219/432] 10.222.0.45 () {58 vars in 1247 bytes} [Thu Jun 16 12:29:44 2022] GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682/ips => generated 151 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:29:44.648638 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6fce9600-8631-496e-a57a-7e236857c645 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:44.657913 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6fce9600-8631-496e-a57a-7e236857c645 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:44.660112 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6fce9600-8631-496e-a57a-7e236857c645 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:44.661567 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6fce9600-8631-496e-a57a-7e236857c645 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1742 microversion: 2.20 time: 0.220616 Jun 16 12:29:44.663228 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 214/433] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:29:44 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1742 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 12:29:45.397369 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-9ae8ca4d-63da-4ccb-a8d3-6221990fd685 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1613657748"}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:29:45.398009 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-9ae8ca4d-63da-4ccb-a8d3-6221990fd685 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] [instance: 17f61c67-8ad3-49b1-9efa-045274e693b2] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:45.407142 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9ae8ca4d-63da-4ccb-a8d3-6221990fd685 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:45.407590 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9ae8ca4d-63da-4ccb-a8d3-6221990fd685 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:45.408366 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9ae8ca4d-63da-4ccb-a8d3-6221990fd685 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:45.408800 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9ae8ca4d-63da-4ccb-a8d3-6221990fd685 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:45.540343 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ad0fa3ec-378b-4960-a4b7-4dcca369f84b tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:45.541531 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ad0fa3ec-378b-4960-a4b7-4dcca369f84b tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] [instance: 8b4082a7-fb3e-463c-840f-0d1eab71722a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:45.542600 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.network.security_group_api [None req-9ae8ca4d-63da-4ccb-a8d3-6221990fd685 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Adding security group 4b2e7b6e-4ea2-49bc-a5b3-a4b509724984 to port 49fea4da-1208-4fe6-931a-6a66f0c864cf Jun 16 12:29:45.548246 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ad0fa3ec-378b-4960-a4b7-4dcca369f84b tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:45.548920 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ad0fa3ec-378b-4960-a4b7-4dcca369f84b tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:45.549688 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ad0fa3ec-378b-4960-a4b7-4dcca369f84b tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:45.550335 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ad0fa3ec-378b-4960-a4b7-4dcca369f84b tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:45.764286 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ad0fa3ec-378b-4960-a4b7-4dcca369f84b tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03828f516fce48d7b00b7027f6848190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10da9307eea6448ca287f557b450e3f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:45.772085 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ad0fa3ec-378b-4960-a4b7-4dcca369f84b tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] 10.222.0.45 "GET /compute/v2.1/servers/8b4082a7-fb3e-463c-840f-0d1eab71722a" status: 200 len: 1314 microversion: 2.1 time: 0.236103 Jun 16 12:29:45.772643 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 215/434] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:45 2022] GET /compute/v2.1/servers/8b4082a7-fb3e-463c-840f-0d1eab71722a => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:29:45.787541 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-bef7ac03-5017-4eac-ae1b-129f6e81da76 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:45.788152 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-bef7ac03-5017-4eac-ae1b-129f6e81da76 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:45.795815 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bef7ac03-5017-4eac-ae1b-129f6e81da76 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:45.795815 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bef7ac03-5017-4eac-ae1b-129f6e81da76 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:45.796432 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bef7ac03-5017-4eac-ae1b-129f6e81da76 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:45.797138 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bef7ac03-5017-4eac-ae1b-129f6e81da76 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:46.099936 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-bef7ac03-5017-4eac-ae1b-129f6e81da76 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:46.110099 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-bef7ac03-5017-4eac-ae1b-129f6e81da76 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:46.110936 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-bef7ac03-5017-4eac-ae1b-129f6e81da76 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:46.112339 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-bef7ac03-5017-4eac-ae1b-129f6e81da76 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1742 microversion: 2.20 time: 0.328807 Jun 16 12:29:46.112996 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 216/435] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:29:45 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1742 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:29:46.171751 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-9ae8ca4d-63da-4ccb-a8d3-6221990fd685 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] 10.222.0.45 "POST /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2/action" status: 202 len: 0 microversion: 2.1 time: 0.778169 Jun 16 12:29:46.172747 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 220/436] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Jun 16 12:29:45 2022] POST /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2/action => generated 0 bytes in 780 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 12:29:46.186872 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-9190800f-af41-4c15-a0fd-bd230c52e1ee req-29c1f63d-dc71-496d-87ac-9cb36a67f886 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17f61c67-8ad3-49b1-9efa-045274e693b2", "tag": "49fea4da-1208-4fe6-931a-6a66f0c864cf"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:29:46.187506 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ba956959-5b7e-4f10-8ea3-66270aba4a67 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:46.188466 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ba956959-5b7e-4f10-8ea3-66270aba4a67 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] [instance: 17f61c67-8ad3-49b1-9efa-045274e693b2] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:46.195121 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ba956959-5b7e-4f10-8ea3-66270aba4a67 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:46.195490 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ba956959-5b7e-4f10-8ea3-66270aba4a67 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:46.196800 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ba956959-5b7e-4f10-8ea3-66270aba4a67 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:46.197771 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ba956959-5b7e-4f10-8ea3-66270aba4a67 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:46.202425 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-9190800f-af41-4c15-a0fd-bd230c52e1ee req-29c1f63d-dc71-496d-87ac-9cb36a67f886 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:46.202532 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-9190800f-af41-4c15-a0fd-bd230c52e1ee req-29c1f63d-dc71-496d-87ac-9cb36a67f886 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:46.216100 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-9190800f-af41-4c15-a0fd-bd230c52e1ee req-29c1f63d-dc71-496d-87ac-9cb36a67f886 service nova] Creating event network-changed:49fea4da-1208-4fe6-931a-6a66f0c864cf for instance 17f61c67-8ad3-49b1-9efa-045274e693b2 on hv-cinder-84614 Jun 16 12:29:46.232601 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-9190800f-af41-4c15-a0fd-bd230c52e1ee req-29c1f63d-dc71-496d-87ac-9cb36a67f886 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053008 Jun 16 12:29:46.232894 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 221/437] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:29:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:29:46.437328 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ba956959-5b7e-4f10-8ea3-66270aba4a67 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e645784fea14d4785df3eefabf77383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01904f10607d4b4bb91b807bff7ba8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:46.445597 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ba956959-5b7e-4f10-8ea3-66270aba4a67 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] 10.222.0.45 "GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2" status: 200 len: 1641 microversion: 2.1 time: 0.268695 Jun 16 12:29:46.454590 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 217/438] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:46 2022] GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2 => generated 1641 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:29:46.791479 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e3aed43b-294c-4e6f-8ed5-5e4531e1b196 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:46.792292 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e3aed43b-294c-4e6f-8ed5-5e4531e1b196 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] [instance: 8b4082a7-fb3e-463c-840f-0d1eab71722a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:46.798571 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e3aed43b-294c-4e6f-8ed5-5e4531e1b196 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:46.799094 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e3aed43b-294c-4e6f-8ed5-5e4531e1b196 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:46.799924 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e3aed43b-294c-4e6f-8ed5-5e4531e1b196 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:46.800447 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e3aed43b-294c-4e6f-8ed5-5e4531e1b196 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:46.941696 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e3aed43b-294c-4e6f-8ed5-5e4531e1b196 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03828f516fce48d7b00b7027f6848190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10da9307eea6448ca287f557b450e3f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:46.950889 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e3aed43b-294c-4e6f-8ed5-5e4531e1b196 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] 10.222.0.45 "GET /compute/v2.1/servers/8b4082a7-fb3e-463c-840f-0d1eab71722a" status: 200 len: 1314 microversion: 2.1 time: 0.164086 Jun 16 12:29:46.951459 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 222/439] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:46 2022] GET /compute/v2.1/servers/8b4082a7-fb3e-463c-840f-0d1eab71722a => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:29:47.131090 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8f570a9e-fa97-4b4e-9800-58aa6d6427ce tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:47.131770 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8f570a9e-fa97-4b4e-9800-58aa6d6427ce tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:47.139451 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8f570a9e-fa97-4b4e-9800-58aa6d6427ce tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:47.139889 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8f570a9e-fa97-4b4e-9800-58aa6d6427ce tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:47.140575 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8f570a9e-fa97-4b4e-9800-58aa6d6427ce tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:47.141011 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8f570a9e-fa97-4b4e-9800-58aa6d6427ce tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:47.171339 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5c03758e-6e31-4ead-a440-6e0f22bf5a6f tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7a1bc1ef-d211-465a-9784-42fb419181e2"}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:29:47.172408 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5c03758e-6e31-4ead-a440-6e0f22bf5a6f tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: ddba5ba6-d9f4-493c-b15b-9443a5426682] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:47.178567 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5c03758e-6e31-4ead-a440-6e0f22bf5a6f tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:47.179017 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5c03758e-6e31-4ead-a440-6e0f22bf5a6f tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:47.179781 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5c03758e-6e31-4ead-a440-6e0f22bf5a6f tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:47.180214 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5c03758e-6e31-4ead-a440-6e0f22bf5a6f tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:47.277057 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8f570a9e-fa97-4b4e-9800-58aa6d6427ce tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:47.285731 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8f570a9e-fa97-4b4e-9800-58aa6d6427ce tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:47.287307 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8f570a9e-fa97-4b4e-9800-58aa6d6427ce tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:47.288457 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8f570a9e-fa97-4b4e-9800-58aa6d6427ce tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1742 microversion: 2.20 time: 0.161646 Jun 16 12:29:47.289028 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 218/440] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:29:47 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1742 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:29:47.968005 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-701eab02-0bcd-46ae-a3a8-f37916d4994c tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:47.968214 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5c03758e-6e31-4ead-a440-6e0f22bf5a6f tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "POST /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.800486 Jun 16 12:29:47.968854 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-701eab02-0bcd-46ae-a3a8-f37916d4994c tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] [instance: 8b4082a7-fb3e-463c-840f-0d1eab71722a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:47.969844 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 223/441] 10.222.0.45 () {60 vars in 1322 bytes} [Thu Jun 16 12:29:47 2022] POST /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682/os-volume_attachments => generated 194 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 12:29:47.976657 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-701eab02-0bcd-46ae-a3a8-f37916d4994c tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:47.977470 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-701eab02-0bcd-46ae-a3a8-f37916d4994c tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:47.979094 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-701eab02-0bcd-46ae-a3a8-f37916d4994c tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:47.981683 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-701eab02-0bcd-46ae-a3a8-f37916d4994c tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:47.996610 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-d14a6a2f-218f-4453-86dd-f9c06eaa2247 req-01995e03-8435-48d0-9852-7822a2f496c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8528919e-1e7a-4807-9b11-ae225e65d4df", "name": "network-vif-plugged", "status": "completed", "tag": "ee66a439-1483-44c8-a66e-9b4920bb00e9"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:29:48.014506 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-d14a6a2f-218f-4453-86dd-f9c06eaa2247 req-01995e03-8435-48d0-9852-7822a2f496c5 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:48.017050 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-d14a6a2f-218f-4453-86dd-f9c06eaa2247 req-01995e03-8435-48d0-9852-7822a2f496c5 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:48.045697 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-d14a6a2f-218f-4453-86dd-f9c06eaa2247 req-01995e03-8435-48d0-9852-7822a2f496c5 service nova] Creating event network-vif-plugged:ee66a439-1483-44c8-a66e-9b4920bb00e9 for instance 8528919e-1e7a-4807-9b11-ae225e65d4df on hv-cinder-84614 Jun 16 12:29:48.063772 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-d14a6a2f-218f-4453-86dd-f9c06eaa2247 req-01995e03-8435-48d0-9852-7822a2f496c5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074436 Jun 16 12:29:48.065032 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 224/442] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:29:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:29:48.174509 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-701eab02-0bcd-46ae-a3a8-f37916d4994c tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03828f516fce48d7b00b7027f6848190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10da9307eea6448ca287f557b450e3f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:48.181892 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-701eab02-0bcd-46ae-a3a8-f37916d4994c tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] 10.222.0.45 "GET /compute/v2.1/servers/8b4082a7-fb3e-463c-840f-0d1eab71722a" status: 200 len: 1499 microversion: 2.1 time: 0.217857 Jun 16 12:29:48.182645 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 219/443] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:47 2022] GET /compute/v2.1/servers/8b4082a7-fb3e-463c-840f-0d1eab71722a => generated 1499 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:29:48.308160 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-58053ad2-56eb-481f-b685-7a3b0e562ff4 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:48.308763 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-58053ad2-56eb-481f-b685-7a3b0e562ff4 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:48.315321 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-58053ad2-56eb-481f-b685-7a3b0e562ff4 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:48.315768 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-58053ad2-56eb-481f-b685-7a3b0e562ff4 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:48.316526 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-58053ad2-56eb-481f-b685-7a3b0e562ff4 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:48.316962 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-58053ad2-56eb-481f-b685-7a3b0e562ff4 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:48.445622 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-58053ad2-56eb-481f-b685-7a3b0e562ff4 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:48.453559 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-58053ad2-56eb-481f-b685-7a3b0e562ff4 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:48.455088 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-58053ad2-56eb-481f-b685-7a3b0e562ff4 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:48.456235 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-58053ad2-56eb-481f-b685-7a3b0e562ff4 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1742 microversion: 2.20 time: 0.152739 Jun 16 12:29:48.456789 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 225/444] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:29:48 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1742 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:29:49.375169 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-05020fa2-f59e-4f07-b9fd-1c82b44fac99 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:49.375709 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-05020fa2-f59e-4f07-b9fd-1c82b44fac99 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] [instance: 8b4082a7-fb3e-463c-840f-0d1eab71722a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:49.382526 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-05020fa2-f59e-4f07-b9fd-1c82b44fac99 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:49.382979 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-05020fa2-f59e-4f07-b9fd-1c82b44fac99 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:49.383739 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-05020fa2-f59e-4f07-b9fd-1c82b44fac99 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:49.384180 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-05020fa2-f59e-4f07-b9fd-1c82b44fac99 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:49.409187 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-05020fa2-f59e-4f07-b9fd-1c82b44fac99 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] [instance: 8b4082a7-fb3e-463c-840f-0d1eab71722a] Going to try to terminate instance {{(pid=117606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 12:29:49.474291 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-36f992ce-45f4-47ad-b05c-fad956168efa tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:49.475165 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-36f992ce-45f4-47ad-b05c-fad956168efa tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:49.482478 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-36f992ce-45f4-47ad-b05c-fad956168efa tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:49.482934 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-36f992ce-45f4-47ad-b05c-fad956168efa tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:49.483708 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-36f992ce-45f4-47ad-b05c-fad956168efa tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:49.484148 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-36f992ce-45f4-47ad-b05c-fad956168efa tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:49.499122 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-05020fa2-f59e-4f07-b9fd-1c82b44fac99 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] 10.222.0.45 "DELETE /compute/v2.1/servers/8b4082a7-fb3e-463c-840f-0d1eab71722a" status: 204 len: 0 microversion: 2.1 time: 0.127570 Jun 16 12:29:49.500013 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 220/445] 10.222.0.45 () {58 vars in 1238 bytes} [Thu Jun 16 12:29:49 2022] DELETE /compute/v2.1/servers/8b4082a7-fb3e-463c-840f-0d1eab71722a => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 12:29:49.508682 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d5497a49-1316-4954-be5f-7377b2d0d37b tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:49.509904 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d5497a49-1316-4954-be5f-7377b2d0d37b tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] [instance: 8b4082a7-fb3e-463c-840f-0d1eab71722a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:49.516504 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d5497a49-1316-4954-be5f-7377b2d0d37b tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:49.516954 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d5497a49-1316-4954-be5f-7377b2d0d37b tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:49.517757 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d5497a49-1316-4954-be5f-7377b2d0d37b tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:49.518224 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d5497a49-1316-4954-be5f-7377b2d0d37b tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:49.689656 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-36f992ce-45f4-47ad-b05c-fad956168efa tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:49.698807 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-36f992ce-45f4-47ad-b05c-fad956168efa tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:49.700236 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-36f992ce-45f4-47ad-b05c-fad956168efa tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:49.701423 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-36f992ce-45f4-47ad-b05c-fad956168efa tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1742 microversion: 2.20 time: 0.231061 Jun 16 12:29:49.701760 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d5497a49-1316-4954-be5f-7377b2d0d37b tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03828f516fce48d7b00b7027f6848190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10da9307eea6448ca287f557b450e3f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:49.701998 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 226/446] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:29:49 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1742 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:29:49.712359 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d5497a49-1316-4954-be5f-7377b2d0d37b tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] 10.222.0.45 "GET /compute/v2.1/servers/8b4082a7-fb3e-463c-840f-0d1eab71722a" status: 200 len: 1505 microversion: 2.1 time: 0.207360 Jun 16 12:29:49.712359 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 221/447] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:49 2022] GET /compute/v2.1/servers/8b4082a7-fb3e-463c-840f-0d1eab71722a => generated 1505 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:29:50.719964 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-68b2e0f2-7d2b-4138-b154-9a649abc7c62 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:50.720575 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-68b2e0f2-7d2b-4138-b154-9a649abc7c62 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:50.727067 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-68b2e0f2-7d2b-4138-b154-9a649abc7c62 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:50.727556 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-68b2e0f2-7d2b-4138-b154-9a649abc7c62 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:50.728209 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-defadb52-f36c-4cf3-9697-a26f9a397014 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:50.728635 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-68b2e0f2-7d2b-4138-b154-9a649abc7c62 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:50.728818 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-defadb52-f36c-4cf3-9697-a26f9a397014 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] [instance: 8b4082a7-fb3e-463c-840f-0d1eab71722a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:50.728936 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-68b2e0f2-7d2b-4138-b154-9a649abc7c62 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:50.735268 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-defadb52-f36c-4cf3-9697-a26f9a397014 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:50.735711 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-defadb52-f36c-4cf3-9697-a26f9a397014 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:50.736471 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-defadb52-f36c-4cf3-9697-a26f9a397014 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:50.736907 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-defadb52-f36c-4cf3-9697-a26f9a397014 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:50.922406 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-68b2e0f2-7d2b-4138-b154-9a649abc7c62 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:50.925486 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-defadb52-f36c-4cf3-9697-a26f9a397014 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03828f516fce48d7b00b7027f6848190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10da9307eea6448ca287f557b450e3f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:50.930344 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-68b2e0f2-7d2b-4138-b154-9a649abc7c62 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:50.931939 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-68b2e0f2-7d2b-4138-b154-9a649abc7c62 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:50.933084 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-defadb52-f36c-4cf3-9697-a26f9a397014 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] 10.222.0.45 "GET /compute/v2.1/servers/8b4082a7-fb3e-463c-840f-0d1eab71722a" status: 200 len: 1505 microversion: 2.1 time: 0.208625 Jun 16 12:29:50.933194 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-68b2e0f2-7d2b-4138-b154-9a649abc7c62 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1742 microversion: 2.20 time: 0.217075 Jun 16 12:29:50.933644 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 222/448] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:50 2022] GET /compute/v2.1/servers/8b4082a7-fb3e-463c-840f-0d1eab71722a => generated 1505 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:29:50.933767 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 227/449] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:29:50 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1742 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:29:51.956012 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-62d35572-0d50-49fa-89ae-a907dfc75af9 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:51.956623 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-62d35572-0d50-49fa-89ae-a907dfc75af9 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] [instance: 8b4082a7-fb3e-463c-840f-0d1eab71722a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:51.961215 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1dfa292f-dbd7-4fc0-88af-a5c452f0fe8c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:51.961853 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1dfa292f-dbd7-4fc0-88af-a5c452f0fe8c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:51.968186 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-62d35572-0d50-49fa-89ae-a907dfc75af9 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:51.968630 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-62d35572-0d50-49fa-89ae-a907dfc75af9 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:51.969375 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1dfa292f-dbd7-4fc0-88af-a5c452f0fe8c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:51.969488 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-62d35572-0d50-49fa-89ae-a907dfc75af9 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:51.969801 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-62d35572-0d50-49fa-89ae-a907dfc75af9 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:51.969935 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1dfa292f-dbd7-4fc0-88af-a5c452f0fe8c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:51.970930 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1dfa292f-dbd7-4fc0-88af-a5c452f0fe8c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:51.971380 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1dfa292f-dbd7-4fc0-88af-a5c452f0fe8c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:51.985065 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:29:52.269112 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-62d35572-0d50-49fa-89ae-a907dfc75af9 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03828f516fce48d7b00b7027f6848190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10da9307eea6448ca287f557b450e3f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:52.278384 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-62d35572-0d50-49fa-89ae-a907dfc75af9 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] 10.222.0.45 "GET /compute/v2.1/servers/8b4082a7-fb3e-463c-840f-0d1eab71722a" status: 200 len: 1505 microversion: 2.1 time: 0.332256 Jun 16 12:29:52.279126 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 228/450] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:51 2022] GET /compute/v2.1/servers/8b4082a7-fb3e-463c-840f-0d1eab71722a => generated 1505 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:29:52.282674 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1dfa292f-dbd7-4fc0-88af-a5c452f0fe8c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:52.292112 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1dfa292f-dbd7-4fc0-88af-a5c452f0fe8c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:52.293619 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1dfa292f-dbd7-4fc0-88af-a5c452f0fe8c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:52.294815 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1dfa292f-dbd7-4fc0-88af-a5c452f0fe8c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1742 microversion: 2.20 time: 0.345648 Jun 16 12:29:52.295308 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-7753e157-0d6b-4243-bee3-a0ff9ee12db1 req-4ea9a7a6-b066-4fd3-b4ae-d66d672fa617 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b4082a7-fb3e-463c-840f-0d1eab71722a", "name": "network-vif-deleted", "tag": "180f3290-6a2a-4814-9ead-30389a941d4e"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:29:52.295442 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 223/451] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:29:51 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1742 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:29:52.304338 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-7753e157-0d6b-4243-bee3-a0ff9ee12db1 req-4ea9a7a6-b066-4fd3-b4ae-d66d672fa617 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:52.304775 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-7753e157-0d6b-4243-bee3-a0ff9ee12db1 req-4ea9a7a6-b066-4fd3-b4ae-d66d672fa617 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:52.318553 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-7753e157-0d6b-4243-bee3-a0ff9ee12db1 req-4ea9a7a6-b066-4fd3-b4ae-d66d672fa617 service nova] Creating event network-vif-deleted:180f3290-6a2a-4814-9ead-30389a941d4e for instance 8b4082a7-fb3e-463c-840f-0d1eab71722a on hv-cinder-84614 Jun 16 12:29:52.323633 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-7753e157-0d6b-4243-bee3-a0ff9ee12db1 req-4ea9a7a6-b066-4fd3-b4ae-d66d672fa617 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032704 Jun 16 12:29:52.324576 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 229/452] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:29:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:29:53.296788 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-df9f3b67-a559-4ecc-9495-1e00efe77770 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:53.297399 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-df9f3b67-a559-4ecc-9495-1e00efe77770 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] [instance: 8b4082a7-fb3e-463c-840f-0d1eab71722a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:53.303870 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-df9f3b67-a559-4ecc-9495-1e00efe77770 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:53.304318 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-df9f3b67-a559-4ecc-9495-1e00efe77770 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:53.305077 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-df9f3b67-a559-4ecc-9495-1e00efe77770 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:53.305507 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-df9f3b67-a559-4ecc-9495-1e00efe77770 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:53.315069 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-04990293-9834-455c-af97-3af9926486c1 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:53.316317 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-04990293-9834-455c-af97-3af9926486c1 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:53.325512 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-04990293-9834-455c-af97-3af9926486c1 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:53.326032 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-04990293-9834-455c-af97-3af9926486c1 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:53.327392 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-04990293-9834-455c-af97-3af9926486c1 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:53.327392 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-04990293-9834-455c-af97-3af9926486c1 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:53.344915 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-df9f3b67-a559-4ecc-9495-1e00efe77770 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:53.345356 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-df9f3b67-a559-4ecc-9495-1e00efe77770 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:53.345801 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.objects.instance [None req-df9f3b67-a559-4ecc-9495-1e00efe77770 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lazy-loading 'fault' on Instance uuid 8b4082a7-fb3e-463c-840f-0d1eab71722a {{(pid=117606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 12:29:53.395575 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-df9f3b67-a559-4ecc-9495-1e00efe77770 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03828f516fce48d7b00b7027f6848190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10da9307eea6448ca287f557b450e3f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:53.404851 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-df9f3b67-a559-4ecc-9495-1e00efe77770 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] 10.222.0.45 "GET /compute/v2.1/servers/8b4082a7-fb3e-463c-840f-0d1eab71722a" status: 200 len: 1304 microversion: 2.1 time: 0.111966 Jun 16 12:29:53.405522 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 224/453] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:53 2022] GET /compute/v2.1/servers/8b4082a7-fb3e-463c-840f-0d1eab71722a => generated 1304 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:29:53.518616 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-04990293-9834-455c-af97-3af9926486c1 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:53.529261 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-04990293-9834-455c-af97-3af9926486c1 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:53.531143 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-04990293-9834-455c-af97-3af9926486c1 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:53.532703 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-04990293-9834-455c-af97-3af9926486c1 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1737 microversion: 2.20 time: 0.222982 Jun 16 12:29:53.534299 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 230/454] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:29:53 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1737 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 12:29:54.453330 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2537be2a-ed86-4d6c-a0f0-d2e28584fc1f tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:54.454272 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2537be2a-ed86-4d6c-a0f0-d2e28584fc1f tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] [instance: 8b4082a7-fb3e-463c-840f-0d1eab71722a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:54.460641 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2537be2a-ed86-4d6c-a0f0-d2e28584fc1f tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:54.461324 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2537be2a-ed86-4d6c-a0f0-d2e28584fc1f tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:54.462154 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2537be2a-ed86-4d6c-a0f0-d2e28584fc1f tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:54.462646 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2537be2a-ed86-4d6c-a0f0-d2e28584fc1f tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:54.476447 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-2537be2a-ed86-4d6c-a0f0-d2e28584fc1f tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] HTTP exception thrown: Instance 8b4082a7-fb3e-463c-840f-0d1eab71722a could not be found. Jun 16 12:29:54.478139 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2537be2a-ed86-4d6c-a0f0-d2e28584fc1f tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Request method failure captured: Jun 16 12:29:54.478139 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: request: GET /compute/v2.1/servers/8b4082a7-fb3e-463c-840f-0d1eab71722a HTTP/1.1 Jun 16 12:29:54.478139 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 16 12:29:54.478139 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 16 12:29:54.478139 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Connection: close Jun 16 12:29:54.478139 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 16 12:29:54.478139 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 16 12:29:54.478139 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Host: 10.222.0.45 Jun 16 12:29:54.478139 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 16 12:29:54.478139 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 16 12:29:54.478139 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABiqyIoAnXrIQ58vSvXSKUkjUtCA6cM2kwP3euQOOxcQS9mHn4cnMY6tW-vQm5FV6ZxbtkKeoMGeoyLFpugxdm56idIJPJN7NaYJlBDG_d1opT6TR7iK2NIX6yMwuh44srpQH4Wu8W7UznG-jeP9ZmR-fEptHFWiOofQqU4ljswMqboCJk Jun 16 12:29:54.478139 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 16 12:29:54.478139 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 16 12:29:54.478139 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 16 12:29:54.478139 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 16 12:29:54.478139 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 16 12:29:54.478139 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 16 12:29:54.478139 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Id: 10da9307eea6448ca287f557b450e3f4 Jun 16 12:29:54.478139 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-VolumesActionsTest-101617276 Jun 16 12:29:54.478139 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 16 12:29:54.478139 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 16 12:29:54.480678 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/10da9307eea6448ca287f557b450e3f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/10da9307eea6448ca287f557b450e3f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_10da9307eea6448ca287f557b450e3f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/10da9307eea6448ca287f557b450e3f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Jun 16 12:29:54.480678 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-VolumesActionsTest-101617276 Jun 16 12:29:54.480678 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 10da9307eea6448ca287f557b450e3f4 Jun 16 12:29:54.480678 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-VolumesActionsTest-101617276 Jun 16 12:29:54.480678 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User: tempest-VolumesActionsTest-101617276-project Jun 16 12:29:54.480678 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 16 12:29:54.480678 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 16 12:29:54.480678 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Id: 03828f516fce48d7b00b7027f6848190 Jun 16 12:29:54.480678 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-VolumesActionsTest-101617276-project Jun 16 12:29:54.480678 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: method: > Jun 16 12:29:54.480678 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: exception: Instance 8b4082a7-fb3e-463c-840f-0d1eab71722a could not be found. Jun 16 12:29:54.480678 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: action_args: {'id': '8b4082a7-fb3e-463c-840f-0d1eab71722a'} Jun 16 12:29:54.481656 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:29:54.481656 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:29:54.481656 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:29:54.481656 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:29:54.481656 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:29:54.481656 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:29:54.481656 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:29:54.481656 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:29:54.481656 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:29:54.481656 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:29:54.481656 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b4082a7-fb3e-463c-840f-0d1eab71722a could not be found. Jun 16 12:29:54.481656 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:29:54.481656 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:29:54.481656 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:29:54.481656 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:29:54.481656 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:29:54.481656 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:29:54.481656 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:29:54.481656 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:29:54.481656 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:29:54.483478 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:29:54.483478 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 12:29:54.483478 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 12:29:54.483478 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:29:54.483478 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:29:54.483478 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:29:54.483478 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:29:54.483478 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b4082a7-fb3e-463c-840f-0d1eab71722a could not be found. Jun 16 12:29:54.483478 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:29:54.483478 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:29:54.483478 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:29:54.483478 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:29:54.483478 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:29:54.483478 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:29:54.483478 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:29:54.483478 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:29:54.483478 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b4082a7-fb3e-463c-840f-0d1eab71722a could not be found. Jun 16 12:29:54.483478 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:29:54.484902 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2537be2a-ed86-4d6c-a0f0-d2e28584fc1f tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Returning 404 to user: Instance 8b4082a7-fb3e-463c-840f-0d1eab71722a could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:29:54.484902 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2537be2a-ed86-4d6c-a0f0-d2e28584fc1f tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] 10.222.0.45 "GET /compute/v2.1/servers/8b4082a7-fb3e-463c-840f-0d1eab71722a" status: 404 len: 111 microversion: 2.1 time: 0.034839 Jun 16 12:29:54.495189 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 225/455] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:54 2022] GET /compute/v2.1/servers/8b4082a7-fb3e-463c-840f-0d1eab71722a => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 12:29:54.535946 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c0f43411-a676-4857-87b4-eada4d677716 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-240369164", "imageRef": "c736a2d2-9d0d-41ec-b9fc-971428b0ff7a", "flavorRef": "452", "networks": [{"uuid": "8e138a49-8247-46da-9027-19340c6518d7"}]}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:29:54.560625 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9caea458-c52c-40e3-95e1-382969bb9617 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:54.561017 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9caea458-c52c-40e3-95e1-382969bb9617 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:54.567124 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9caea458-c52c-40e3-95e1-382969bb9617 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:54.567776 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9caea458-c52c-40e3-95e1-382969bb9617 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:54.568548 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9caea458-c52c-40e3-95e1-382969bb9617 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:54.569195 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9caea458-c52c-40e3-95e1-382969bb9617 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:54.611788 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.network.neutron [None req-c0f43411-a676-4857-87b4-eada4d677716 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] validate_networks() for [('8e138a49-8247-46da-9027-19340c6518d7', None, None, None, None, None)] {{(pid=117607) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 12:29:54.839404 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9caea458-c52c-40e3-95e1-382969bb9617 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:54.847906 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9caea458-c52c-40e3-95e1-382969bb9617 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:54.849629 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9caea458-c52c-40e3-95e1-382969bb9617 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:54.851358 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9caea458-c52c-40e3-95e1-382969bb9617 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1737 microversion: 2.20 time: 0.298486 Jun 16 12:29:54.862604 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 226/456] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:29:54 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1737 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 12:29:54.867937 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-343b2e27-29d5-42ab-819e-5ac62750e75f tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f409a6f5-a8da-42be-88e9-e632530a0a9d", "device": "/dev/sdb"}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:29:54.870430 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-343b2e27-29d5-42ab-819e-5ac62750e75f tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] [instance: c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:54.877109 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-343b2e27-29d5-42ab-819e-5ac62750e75f tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:54.877795 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-343b2e27-29d5-42ab-819e-5ac62750e75f tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:54.878785 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-343b2e27-29d5-42ab-819e-5ac62750e75f tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:54.879374 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-343b2e27-29d5-42ab-819e-5ac62750e75f tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:55.287656 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-343b2e27-29d5-42ab-819e-5ac62750e75f tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] 10.222.0.45 "POST /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.423400 Jun 16 12:29:55.289098 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 227/457] 10.222.0.45 () {60 vars in 1322 bytes} [Thu Jun 16 12:29:54 2022] POST /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33/os-volume_attachments => generated 194 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:29:55.510616 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-c0f43411-a676-4857-87b4-eada4d677716 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Flavor limits 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 12:29:55.511282 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-c0f43411-a676-4857-87b4-eada4d677716 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Image limits 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 12:29:55.511822 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-c0f43411-a676-4857-87b4-eada4d677716 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Flavor pref 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 12:29:55.512226 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-c0f43411-a676-4857-87b4-eada4d677716 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Image pref 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 12:29:55.513212 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-c0f43411-a676-4857-87b4-eada4d677716 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 12:29:55.522731 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c0f43411-a676-4857-87b4-eada4d677716 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:55.523649 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c0f43411-a676-4857-87b4-eada4d677716 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:55.524573 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c0f43411-a676-4857-87b4-eada4d677716 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:55.525108 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c0f43411-a676-4857-87b4-eada4d677716 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:55.546128 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-c0f43411-a676-4857-87b4-eada4d677716 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Getting quotas for project 10da9307eea6448ca287f557b450e3f4. Resources: {'instances', 'cores', 'ram'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 12:29:55.550420 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-c0f43411-a676-4857-87b4-eada4d677716 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Getting quotas for user 03828f516fce48d7b00b7027f6848190 and project 10da9307eea6448ca287f557b450e3f4. Resources: {'instances', 'cores', 'ram'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 12:29:55.562192 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c0f43411-a676-4857-87b4-eada4d677716 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Going to run 1 instances... {{(pid=117607) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 12:29:55.564797 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c0f43411-a676-4857-87b4-eada4d677716 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] [instance: 6bc83901-92e8-41d6-836a-bf66159a61fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c736a2d2-9d0d-41ec-b9fc-971428b0ff7a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117607) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 12:29:55.617494 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c0f43411-a676-4857-87b4-eada4d677716 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.085533 Jun 16 12:29:55.619309 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 231/458] 10.222.0.45 () {60 vars in 1146 bytes} [Thu Jun 16 12:29:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1087 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 12:29:55.645614 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-61d69f92-7602-42d5-ab44-533a589cd992 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:55.647388 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-61d69f92-7602-42d5-ab44-533a589cd992 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] [instance: 6bc83901-92e8-41d6-836a-bf66159a61fe] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:55.739606 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-61d69f92-7602-42d5-ab44-533a589cd992 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03828f516fce48d7b00b7027f6848190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10da9307eea6448ca287f557b450e3f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:55.750284 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-61d69f92-7602-42d5-ab44-533a589cd992 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] 10.222.0.45 "GET /compute/v2.1/servers/6bc83901-92e8-41d6-836a-bf66159a61fe" status: 200 len: 1213 microversion: 2.1 time: 0.124564 Jun 16 12:29:55.751354 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 228/459] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:55 2022] GET /compute/v2.1/servers/6bc83901-92e8-41d6-836a-bf66159a61fe => generated 1213 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:29:55.869700 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1c746f57-c8f2-40eb-af50-48e15398ffb8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:55.870334 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1c746f57-c8f2-40eb-af50-48e15398ffb8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:55.879515 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1c746f57-c8f2-40eb-af50-48e15398ffb8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:55.879904 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1c746f57-c8f2-40eb-af50-48e15398ffb8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:55.880888 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1c746f57-c8f2-40eb-af50-48e15398ffb8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:55.881408 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1c746f57-c8f2-40eb-af50-48e15398ffb8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:56.036650 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1c746f57-c8f2-40eb-af50-48e15398ffb8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:56.046336 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1c746f57-c8f2-40eb-af50-48e15398ffb8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:56.047864 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1c746f57-c8f2-40eb-af50-48e15398ffb8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:56.049026 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1c746f57-c8f2-40eb-af50-48e15398ffb8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1737 microversion: 2.20 time: 0.183769 Jun 16 12:29:56.049789 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 232/460] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:29:55 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1737 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:29:56.771669 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-bb62cf68-a492-4994-93bc-27fc632896c0 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:56.772276 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-bb62cf68-a492-4994-93bc-27fc632896c0 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] [instance: 6bc83901-92e8-41d6-836a-bf66159a61fe] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:56.796184 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bb62cf68-a492-4994-93bc-27fc632896c0 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:56.805053 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bb62cf68-a492-4994-93bc-27fc632896c0 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:56.806345 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bb62cf68-a492-4994-93bc-27fc632896c0 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:56.807539 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bb62cf68-a492-4994-93bc-27fc632896c0 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:56.836421 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:29:56.891264 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-bb62cf68-a492-4994-93bc-27fc632896c0 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03828f516fce48d7b00b7027f6848190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10da9307eea6448ca287f557b450e3f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:56.905303 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-bb62cf68-a492-4994-93bc-27fc632896c0 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] 10.222.0.45 "GET /compute/v2.1/servers/6bc83901-92e8-41d6-836a-bf66159a61fe" status: 200 len: 1217 microversion: 2.1 time: 0.140964 Jun 16 12:29:56.907505 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 229/461] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:56 2022] GET /compute/v2.1/servers/6bc83901-92e8-41d6-836a-bf66159a61fe => generated 1217 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:29:57.069590 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-15c9a3d3-af3f-4156-9c83-889e22f3a71e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:57.071143 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-15c9a3d3-af3f-4156-9c83-889e22f3a71e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:57.079426 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-15c9a3d3-af3f-4156-9c83-889e22f3a71e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:57.079974 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-15c9a3d3-af3f-4156-9c83-889e22f3a71e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:57.080855 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-15c9a3d3-af3f-4156-9c83-889e22f3a71e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:57.081567 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-15c9a3d3-af3f-4156-9c83-889e22f3a71e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:57.225133 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-15c9a3d3-af3f-4156-9c83-889e22f3a71e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:57.234314 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-15c9a3d3-af3f-4156-9c83-889e22f3a71e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:57.236207 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-15c9a3d3-af3f-4156-9c83-889e22f3a71e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:57.237611 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-15c9a3d3-af3f-4156-9c83-889e22f3a71e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1737 microversion: 2.20 time: 0.172266 Jun 16 12:29:57.238207 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 233/462] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:29:57 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1737 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 12:29:57.922801 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-eb5da407-3b00-48ae-b465-ee108d5ac680 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:57.923406 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-eb5da407-3b00-48ae-b465-ee108d5ac680 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] [instance: 6bc83901-92e8-41d6-836a-bf66159a61fe] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:57.938133 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eb5da407-3b00-48ae-b465-ee108d5ac680 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:57.938133 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eb5da407-3b00-48ae-b465-ee108d5ac680 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:57.938133 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eb5da407-3b00-48ae-b465-ee108d5ac680 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:57.938133 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eb5da407-3b00-48ae-b465-ee108d5ac680 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:57.949756 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8b4b337b-bdb4-4547-9135-f183081e3d81 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Action: 'create', calling method: .version_select at 0x7f7c721e1ca0>, body: {"keypair": {"name": "tempest-keypair-1611914687", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAjK5cONQiRBQDVgg5tHvTHJtMS2WT4+ls8WbBm11OIe/qyHEQ943QdReLX4kd2ETUZXWs69eWKt3o6WRA29IrKBO87wTa0Ya0nsrkrp9W1/QlNVKPL0JrZmjegQdICVfw=="}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:29:57.978838 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-8b4b337b-bdb4-4547-9135-f183081e3d81 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Getting quotas for project 3fce886a9a894240a0b3bd3af94d2465. Resources: {'key_pairs'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 12:29:58.000399 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-8b4b337b-bdb4-4547-9135-f183081e3d81 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Getting quotas for user ed6b630c60d640afb1325215ea27acef and project 3fce886a9a894240a0b3bd3af94d2465. Resources: {'key_pairs'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 12:29:58.038157 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-eb5da407-3b00-48ae-b465-ee108d5ac680 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03828f516fce48d7b00b7027f6848190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10da9307eea6448ca287f557b450e3f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:58.042939 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8b4b337b-bdb4-4547-9135-f183081e3d81 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.101473 Jun 16 12:29:58.045908 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 234/463] 10.222.0.45 () {60 vars in 1158 bytes} [Thu Jun 16 12:29:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:29:58.068476 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-eb5da407-3b00-48ae-b465-ee108d5ac680 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] 10.222.0.45 "GET /compute/v2.1/servers/6bc83901-92e8-41d6-836a-bf66159a61fe" status: 200 len: 1265 microversion: 2.1 time: 0.149505 Jun 16 12:29:58.079797 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 230/464] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:57 2022] GET /compute/v2.1/servers/6bc83901-92e8-41d6-836a-bf66159a61fe => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:29:58.257886 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-abfc46f6-483e-4703-a51c-6c49b301302b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:58.259248 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-abfc46f6-483e-4703-a51c-6c49b301302b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:58.268648 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-abfc46f6-483e-4703-a51c-6c49b301302b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:58.269487 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-abfc46f6-483e-4703-a51c-6c49b301302b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:58.271105 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-abfc46f6-483e-4703-a51c-6c49b301302b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:58.271823 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-abfc46f6-483e-4703-a51c-6c49b301302b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:58.522386 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-abfc46f6-483e-4703-a51c-6c49b301302b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:58.539027 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-abfc46f6-483e-4703-a51c-6c49b301302b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:58.541091 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-abfc46f6-483e-4703-a51c-6c49b301302b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:58.542791 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-abfc46f6-483e-4703-a51c-6c49b301302b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1737 microversion: 2.20 time: 0.289911 Jun 16 12:29:58.543533 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 235/465] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:29:58 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1737 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:29:59.086966 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-30eba088-dbfb-4dcb-b5fb-3a886c68c071 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:59.088407 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-30eba088-dbfb-4dcb-b5fb-3a886c68c071 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] [instance: 6bc83901-92e8-41d6-836a-bf66159a61fe] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:59.099182 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-30eba088-dbfb-4dcb-b5fb-3a886c68c071 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:59.099950 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-30eba088-dbfb-4dcb-b5fb-3a886c68c071 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:59.101216 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-30eba088-dbfb-4dcb-b5fb-3a886c68c071 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:59.101786 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-30eba088-dbfb-4dcb-b5fb-3a886c68c071 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:59.199286 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-30eba088-dbfb-4dcb-b5fb-3a886c68c071 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03828f516fce48d7b00b7027f6848190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10da9307eea6448ca287f557b450e3f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:59.214977 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-30eba088-dbfb-4dcb-b5fb-3a886c68c071 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] 10.222.0.45 "GET /compute/v2.1/servers/6bc83901-92e8-41d6-836a-bf66159a61fe" status: 200 len: 1271 microversion: 2.1 time: 0.131189 Jun 16 12:29:59.226826 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 231/466] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:29:59 2022] GET /compute/v2.1/servers/6bc83901-92e8-41d6-836a-bf66159a61fe => generated 1271 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:29:59.562716 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7c3d9e99-ddae-4178-bd93-eccc8269e98a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:29:59.564742 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7c3d9e99-ddae-4178-bd93-eccc8269e98a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:29:59.575820 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7c3d9e99-ddae-4178-bd93-eccc8269e98a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:59.577032 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7c3d9e99-ddae-4178-bd93-eccc8269e98a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:59.578042 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7c3d9e99-ddae-4178-bd93-eccc8269e98a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:29:59.579126 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7c3d9e99-ddae-4178-bd93-eccc8269e98a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:29:59.884597 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7c3d9e99-ddae-4178-bd93-eccc8269e98a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:59.904498 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7c3d9e99-ddae-4178-bd93-eccc8269e98a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:59.907564 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7c3d9e99-ddae-4178-bd93-eccc8269e98a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:29:59.909906 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7c3d9e99-ddae-4178-bd93-eccc8269e98a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1737 microversion: 2.20 time: 0.351069 Jun 16 12:29:59.911083 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 236/467] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:29:59 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1737 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:30:00.092208 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2b343f8e-b61e-4d8b-9665-e51213d73dd2 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-641953868", "imageRef": "c736a2d2-9d0d-41ec-b9fc-971428b0ff7a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "151a2bee-6229-46e8-95f9-7544fde552a8"}], "security_groups": [{"name": "tempest-securitygroup--1147519240"}], "key_name": "tempest-keypair-1611914687", "user_data": "}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:30:00.233312 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b09f34cc-245a-47a4-9850-76ee85c8aebe tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:00.234235 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b09f34cc-245a-47a4-9850-76ee85c8aebe tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] [instance: 6bc83901-92e8-41d6-836a-bf66159a61fe] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:00.245913 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b09f34cc-245a-47a4-9850-76ee85c8aebe tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:00.248342 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.network.neutron [None req-2b343f8e-b61e-4d8b-9665-e51213d73dd2 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] validate_networks() for [('151a2bee-6229-46e8-95f9-7544fde552a8', None, None, None, None, None)] {{(pid=117606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 12:30:00.253704 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b09f34cc-245a-47a4-9850-76ee85c8aebe tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:00.254926 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b09f34cc-245a-47a4-9850-76ee85c8aebe tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:00.255513 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b09f34cc-245a-47a4-9850-76ee85c8aebe tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:00.570925 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b09f34cc-245a-47a4-9850-76ee85c8aebe tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03828f516fce48d7b00b7027f6848190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10da9307eea6448ca287f557b450e3f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:00.592725 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b09f34cc-245a-47a4-9850-76ee85c8aebe tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] 10.222.0.45 "GET /compute/v2.1/servers/6bc83901-92e8-41d6-836a-bf66159a61fe" status: 200 len: 1313 microversion: 2.1 time: 0.362889 Jun 16 12:30:00.594129 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 237/468] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:00 2022] GET /compute/v2.1/servers/6bc83901-92e8-41d6-836a-bf66159a61fe => generated 1313 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:30:00.599757 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-a597c3f4-bdcc-4cf7-85dc-a709cb24ea17 req-f1924c2d-5105-4ea8-b36b-2b4d5f480e31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bc83901-92e8-41d6-836a-bf66159a61fe", "tag": "c2d25ec4-314d-4236-8c08-702eec94ea43"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:30:00.611053 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-a597c3f4-bdcc-4cf7-85dc-a709cb24ea17 req-f1924c2d-5105-4ea8-b36b-2b4d5f480e31 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:00.611846 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-a597c3f4-bdcc-4cf7-85dc-a709cb24ea17 req-f1924c2d-5105-4ea8-b36b-2b4d5f480e31 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:00.629647 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-a597c3f4-bdcc-4cf7-85dc-a709cb24ea17 req-f1924c2d-5105-4ea8-b36b-2b4d5f480e31 service nova] Creating event network-changed:c2d25ec4-314d-4236-8c08-702eec94ea43 for instance 6bc83901-92e8-41d6-836a-bf66159a61fe on hv-cinder-84614 Jun 16 12:30:00.635150 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-a597c3f4-bdcc-4cf7-85dc-a709cb24ea17 req-f1924c2d-5105-4ea8-b36b-2b4d5f480e31 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039055 Jun 16 12:30:00.636663 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 238/469] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:30:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:30:00.929463 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-9aa184cf-b538-4cca-b018-e5a1e5154df6 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:00.930428 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-9aa184cf-b538-4cca-b018-e5a1e5154df6 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:00.937220 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9aa184cf-b538-4cca-b018-e5a1e5154df6 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:00.937799 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9aa184cf-b538-4cca-b018-e5a1e5154df6 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:00.938920 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9aa184cf-b538-4cca-b018-e5a1e5154df6 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:00.940323 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9aa184cf-b538-4cca-b018-e5a1e5154df6 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:01.173645 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-2b343f8e-b61e-4d8b-9665-e51213d73dd2 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Flavor limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 12:30:01.174825 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-2b343f8e-b61e-4d8b-9665-e51213d73dd2 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Image limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 12:30:01.175313 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-2b343f8e-b61e-4d8b-9665-e51213d73dd2 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Flavor pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 12:30:01.175734 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-2b343f8e-b61e-4d8b-9665-e51213d73dd2 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Image pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 12:30:01.176365 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-2b343f8e-b61e-4d8b-9665-e51213d73dd2 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 12:30:01.186850 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2b343f8e-b61e-4d8b-9665-e51213d73dd2 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:01.187603 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2b343f8e-b61e-4d8b-9665-e51213d73dd2 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:01.188411 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2b343f8e-b61e-4d8b-9665-e51213d73dd2 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:01.188849 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2b343f8e-b61e-4d8b-9665-e51213d73dd2 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:01.214175 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-2b343f8e-b61e-4d8b-9665-e51213d73dd2 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Getting quotas for project 3fce886a9a894240a0b3bd3af94d2465. Resources: {'instances', 'cores', 'ram'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 12:30:01.218769 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-2b343f8e-b61e-4d8b-9665-e51213d73dd2 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Getting quotas for user ed6b630c60d640afb1325215ea27acef and project 3fce886a9a894240a0b3bd3af94d2465. Resources: {'instances', 'cores', 'ram'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 12:30:01.244478 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2b343f8e-b61e-4d8b-9665-e51213d73dd2 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Going to run 1 instances... {{(pid=117606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 12:30:01.247369 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2b343f8e-b61e-4d8b-9665-e51213d73dd2 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9abc4b09-7cfc-47dc-b778-684eb2e331b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c736a2d2-9d0d-41ec-b9fc-971428b0ff7a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 12:30:01.296808 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2b343f8e-b61e-4d8b-9665-e51213d73dd2 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.213788 Jun 16 12:30:01.298078 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 232/470] 10.222.0.45 () {60 vars in 1146 bytes} [Thu Jun 16 12:30:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 1216 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 12:30:01.302994 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-9aa184cf-b538-4cca-b018-e5a1e5154df6 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:01.311306 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3ded5c42-5416-4789-ba94-1918b4dbfe60 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:01.316555 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-9aa184cf-b538-4cca-b018-e5a1e5154df6 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:01.318325 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-9aa184cf-b538-4cca-b018-e5a1e5154df6 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:01.319705 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-9aa184cf-b538-4cca-b018-e5a1e5154df6 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1737 microversion: 2.20 time: 0.394868 Jun 16 12:30:01.320605 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3ded5c42-5416-4789-ba94-1918b4dbfe60 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9abc4b09-7cfc-47dc-b778-684eb2e331b9] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:01.325179 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 239/471] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:30:00 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1737 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:30:01.390345 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3ded5c42-5416-4789-ba94-1918b4dbfe60 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:01.398179 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3ded5c42-5416-4789-ba94-1918b4dbfe60 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9" status: 200 len: 1241 microversion: 2.1 time: 0.090578 Jun 16 12:30:01.402011 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 233/472] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:01 2022] GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9 => generated 1241 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:30:01.610846 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d3e09356-e889-41fa-9b34-10033a8632ea tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:01.611782 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d3e09356-e889-41fa-9b34-10033a8632ea tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] [instance: 6bc83901-92e8-41d6-836a-bf66159a61fe] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:01.626414 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d3e09356-e889-41fa-9b34-10033a8632ea tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:01.627233 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d3e09356-e889-41fa-9b34-10033a8632ea tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:01.629234 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d3e09356-e889-41fa-9b34-10033a8632ea tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:01.629981 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d3e09356-e889-41fa-9b34-10033a8632ea tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:01.810545 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d3e09356-e889-41fa-9b34-10033a8632ea tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03828f516fce48d7b00b7027f6848190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10da9307eea6448ca287f557b450e3f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:01.826786 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d3e09356-e889-41fa-9b34-10033a8632ea tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] 10.222.0.45 "GET /compute/v2.1/servers/6bc83901-92e8-41d6-836a-bf66159a61fe" status: 200 len: 1313 microversion: 2.1 time: 0.220443 Jun 16 12:30:01.827366 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 240/473] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:01 2022] GET /compute/v2.1/servers/6bc83901-92e8-41d6-836a-bf66159a61fe => generated 1313 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:30:02.343619 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-72ed32bd-8f16-49ab-abfc-043712b0a902 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:02.344196 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-72ed32bd-8f16-49ab-abfc-043712b0a902 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:02.355935 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-72ed32bd-8f16-49ab-abfc-043712b0a902 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:02.356391 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-72ed32bd-8f16-49ab-abfc-043712b0a902 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:02.357161 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-72ed32bd-8f16-49ab-abfc-043712b0a902 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:02.357596 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-72ed32bd-8f16-49ab-abfc-043712b0a902 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:02.415518 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-50e99946-7205-420a-87a3-28dfbb7f7911 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:02.416127 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-50e99946-7205-420a-87a3-28dfbb7f7911 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9abc4b09-7cfc-47dc-b778-684eb2e331b9] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:02.422772 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-50e99946-7205-420a-87a3-28dfbb7f7911 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:02.423496 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-50e99946-7205-420a-87a3-28dfbb7f7911 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:02.424853 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-50e99946-7205-420a-87a3-28dfbb7f7911 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:02.425495 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-50e99946-7205-420a-87a3-28dfbb7f7911 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:02.511617 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-50e99946-7205-420a-87a3-28dfbb7f7911 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:02.520109 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-50e99946-7205-420a-87a3-28dfbb7f7911 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9" status: 200 len: 1245 microversion: 2.1 time: 0.108311 Jun 16 12:30:02.530921 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 241/474] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:02 2022] GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9 => generated 1245 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:30:02.535256 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-72ed32bd-8f16-49ab-abfc-043712b0a902 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:02.546019 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-72ed32bd-8f16-49ab-abfc-043712b0a902 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:02.547512 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-72ed32bd-8f16-49ab-abfc-043712b0a902 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:02.548663 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-72ed32bd-8f16-49ab-abfc-043712b0a902 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1737 microversion: 2.20 time: 0.209063 Jun 16 12:30:02.549215 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 234/475] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:30:02 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1737 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:30:02.844225 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f9416f2a-b047-46fe-ab3e-dfdfad953598 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:02.845011 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f9416f2a-b047-46fe-ab3e-dfdfad953598 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] [instance: 6bc83901-92e8-41d6-836a-bf66159a61fe] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:02.856765 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f9416f2a-b047-46fe-ab3e-dfdfad953598 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:02.857713 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f9416f2a-b047-46fe-ab3e-dfdfad953598 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:02.858725 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f9416f2a-b047-46fe-ab3e-dfdfad953598 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:02.859377 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f9416f2a-b047-46fe-ab3e-dfdfad953598 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:02.997108 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f9416f2a-b047-46fe-ab3e-dfdfad953598 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03828f516fce48d7b00b7027f6848190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10da9307eea6448ca287f557b450e3f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:03.005328 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f9416f2a-b047-46fe-ab3e-dfdfad953598 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] 10.222.0.45 "GET /compute/v2.1/servers/6bc83901-92e8-41d6-836a-bf66159a61fe" status: 200 len: 1313 microversion: 2.1 time: 0.165265 Jun 16 12:30:03.006203 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 242/476] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:02 2022] GET /compute/v2.1/servers/6bc83901-92e8-41d6-836a-bf66159a61fe => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:30:03.539455 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5f8d2d60-cb34-4d0e-a459-5c48f1c779da tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:03.540796 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5f8d2d60-cb34-4d0e-a459-5c48f1c779da tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9abc4b09-7cfc-47dc-b778-684eb2e331b9] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:03.550716 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5f8d2d60-cb34-4d0e-a459-5c48f1c779da tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:03.552482 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5f8d2d60-cb34-4d0e-a459-5c48f1c779da tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:03.554445 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5f8d2d60-cb34-4d0e-a459-5c48f1c779da tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:03.554962 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5f8d2d60-cb34-4d0e-a459-5c48f1c779da tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:03.571441 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-592601d8-4afb-44c2-af73-cd7faea5add2 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:03.572447 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-592601d8-4afb-44c2-af73-cd7faea5add2 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:03.581618 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-592601d8-4afb-44c2-af73-cd7faea5add2 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:03.582399 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-592601d8-4afb-44c2-af73-cd7faea5add2 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:03.583390 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-592601d8-4afb-44c2-af73-cd7faea5add2 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:03.584031 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-592601d8-4afb-44c2-af73-cd7faea5add2 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:03.654713 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5f8d2d60-cb34-4d0e-a459-5c48f1c779da tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:03.664643 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5f8d2d60-cb34-4d0e-a459-5c48f1c779da tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9" status: 200 len: 1245 microversion: 2.1 time: 0.130785 Jun 16 12:30:03.666405 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 235/477] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:03 2022] GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9 => generated 1245 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:30:03.779253 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-592601d8-4afb-44c2-af73-cd7faea5add2 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:03.788526 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-592601d8-4afb-44c2-af73-cd7faea5add2 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:03.790284 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-592601d8-4afb-44c2-af73-cd7faea5add2 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:03.792030 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-592601d8-4afb-44c2-af73-cd7faea5add2 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1737 microversion: 2.20 time: 0.224419 Jun 16 12:30:03.793171 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 243/478] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:30:03 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1737 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:30:04.021926 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-02dc4238-a718-4463-9abf-5a0e743c9cc2 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:04.022534 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-02dc4238-a718-4463-9abf-5a0e743c9cc2 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] [instance: 6bc83901-92e8-41d6-836a-bf66159a61fe] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:04.029132 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-02dc4238-a718-4463-9abf-5a0e743c9cc2 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:04.029557 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-02dc4238-a718-4463-9abf-5a0e743c9cc2 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:04.030339 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-02dc4238-a718-4463-9abf-5a0e743c9cc2 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:04.030769 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-02dc4238-a718-4463-9abf-5a0e743c9cc2 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:04.155915 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-02dc4238-a718-4463-9abf-5a0e743c9cc2 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03828f516fce48d7b00b7027f6848190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10da9307eea6448ca287f557b450e3f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:04.163382 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-02dc4238-a718-4463-9abf-5a0e743c9cc2 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] 10.222.0.45 "GET /compute/v2.1/servers/6bc83901-92e8-41d6-836a-bf66159a61fe" status: 200 len: 1313 microversion: 2.1 time: 0.145380 Jun 16 12:30:04.163938 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 236/479] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:04 2022] GET /compute/v2.1/servers/6bc83901-92e8-41d6-836a-bf66159a61fe => generated 1313 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:30:04.682883 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-739f4022-48c5-4331-8ca3-a44f5530ccec tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:04.684164 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-739f4022-48c5-4331-8ca3-a44f5530ccec tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9abc4b09-7cfc-47dc-b778-684eb2e331b9] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:04.690843 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-739f4022-48c5-4331-8ca3-a44f5530ccec tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:04.691294 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-739f4022-48c5-4331-8ca3-a44f5530ccec tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:04.692059 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-739f4022-48c5-4331-8ca3-a44f5530ccec tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:04.692527 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-739f4022-48c5-4331-8ca3-a44f5530ccec tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:04.758533 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-739f4022-48c5-4331-8ca3-a44f5530ccec tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:04.768546 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-739f4022-48c5-4331-8ca3-a44f5530ccec tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9" status: 200 len: 1245 microversion: 2.1 time: 0.089941 Jun 16 12:30:04.775288 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 244/480] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:04 2022] GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9 => generated 1245 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:30:04.810809 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e093ec19-7a33-4d38-9e42-d8ffd1d634b5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:04.811482 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e093ec19-7a33-4d38-9e42-d8ffd1d634b5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:04.820553 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e093ec19-7a33-4d38-9e42-d8ffd1d634b5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:04.821017 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e093ec19-7a33-4d38-9e42-d8ffd1d634b5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:04.821829 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e093ec19-7a33-4d38-9e42-d8ffd1d634b5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:04.822335 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e093ec19-7a33-4d38-9e42-d8ffd1d634b5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:05.020562 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e093ec19-7a33-4d38-9e42-d8ffd1d634b5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:05.029734 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e093ec19-7a33-4d38-9e42-d8ffd1d634b5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:05.031349 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e093ec19-7a33-4d38-9e42-d8ffd1d634b5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:05.032505 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e093ec19-7a33-4d38-9e42-d8ffd1d634b5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1737 microversion: 2.20 time: 0.226242 Jun 16 12:30:05.033232 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 237/481] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:30:04 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1737 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:30:05.180633 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d80f505d-3cd9-4b06-b3bc-fd22386d16e8 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:05.181278 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d80f505d-3cd9-4b06-b3bc-fd22386d16e8 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] [instance: 6bc83901-92e8-41d6-836a-bf66159a61fe] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:05.189463 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d80f505d-3cd9-4b06-b3bc-fd22386d16e8 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:05.189841 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d80f505d-3cd9-4b06-b3bc-fd22386d16e8 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:05.190632 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d80f505d-3cd9-4b06-b3bc-fd22386d16e8 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:05.191062 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d80f505d-3cd9-4b06-b3bc-fd22386d16e8 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:05.344602 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d80f505d-3cd9-4b06-b3bc-fd22386d16e8 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03828f516fce48d7b00b7027f6848190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10da9307eea6448ca287f557b450e3f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:05.365323 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d80f505d-3cd9-4b06-b3bc-fd22386d16e8 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] 10.222.0.45 "GET /compute/v2.1/servers/6bc83901-92e8-41d6-836a-bf66159a61fe" status: 200 len: 1313 microversion: 2.1 time: 0.180840 Jun 16 12:30:05.367809 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 245/482] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:05 2022] GET /compute/v2.1/servers/6bc83901-92e8-41d6-836a-bf66159a61fe => generated 1313 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:30:05.541226 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 12:30:05.541687 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Thu Jun 16 12:30:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 12:30:05.785930 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-30330568-0dd2-400b-b350-3944e2302a98 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:05.786471 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-30330568-0dd2-400b-b350-3944e2302a98 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9abc4b09-7cfc-47dc-b778-684eb2e331b9] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:05.795582 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-30330568-0dd2-400b-b350-3944e2302a98 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:05.796129 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-30330568-0dd2-400b-b350-3944e2302a98 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:05.797105 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-30330568-0dd2-400b-b350-3944e2302a98 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:05.797615 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-30330568-0dd2-400b-b350-3944e2302a98 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:05.891925 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-30330568-0dd2-400b-b350-3944e2302a98 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:05.899900 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-30330568-0dd2-400b-b350-3944e2302a98 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9" status: 200 len: 1293 microversion: 2.1 time: 0.118109 Jun 16 12:30:05.909537 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 238/483] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:05 2022] GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9 => generated 1293 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:30:06.056337 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e0cb6f77-c6c0-4a89-a054-7fdcf2605748 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:06.057631 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e0cb6f77-c6c0-4a89-a054-7fdcf2605748 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:06.064532 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell0:SELECT=2 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:30:06.068482 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:30:06.082798 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e0cb6f77-c6c0-4a89-a054-7fdcf2605748 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:06.084059 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e0cb6f77-c6c0-4a89-a054-7fdcf2605748 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:06.086502 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e0cb6f77-c6c0-4a89-a054-7fdcf2605748 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:06.087291 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e0cb6f77-c6c0-4a89-a054-7fdcf2605748 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:06.281208 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e0cb6f77-c6c0-4a89-a054-7fdcf2605748 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:06.298664 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e0cb6f77-c6c0-4a89-a054-7fdcf2605748 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:06.300520 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e0cb6f77-c6c0-4a89-a054-7fdcf2605748 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:06.301816 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e0cb6f77-c6c0-4a89-a054-7fdcf2605748 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1737 microversion: 2.20 time: 0.254507 Jun 16 12:30:06.302602 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 246/484] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:30:06 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1737 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:30:06.375676 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-09dff772-148f-4627-b7c0-b8a5fe0b427e tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:06.376678 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-09dff772-148f-4627-b7c0-b8a5fe0b427e tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] [instance: 6bc83901-92e8-41d6-836a-bf66159a61fe] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:06.382731 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-09dff772-148f-4627-b7c0-b8a5fe0b427e tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:06.383389 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-09dff772-148f-4627-b7c0-b8a5fe0b427e tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:06.384159 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-09dff772-148f-4627-b7c0-b8a5fe0b427e tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:06.385995 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-09dff772-148f-4627-b7c0-b8a5fe0b427e tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:06.812431 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-09dff772-148f-4627-b7c0-b8a5fe0b427e tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03828f516fce48d7b00b7027f6848190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10da9307eea6448ca287f557b450e3f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:06.820437 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-09dff772-148f-4627-b7c0-b8a5fe0b427e tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] 10.222.0.45 "GET /compute/v2.1/servers/6bc83901-92e8-41d6-836a-bf66159a61fe" status: 200 len: 1313 microversion: 2.1 time: 0.449493 Jun 16 12:30:06.821004 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 239/485] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:06 2022] GET /compute/v2.1/servers/6bc83901-92e8-41d6-836a-bf66159a61fe => generated 1313 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:30:06.917170 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d1c375db-e541-416f-b983-9907ce4766f5 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:06.917795 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d1c375db-e541-416f-b983-9907ce4766f5 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9abc4b09-7cfc-47dc-b778-684eb2e331b9] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:06.923737 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d1c375db-e541-416f-b983-9907ce4766f5 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:06.924187 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d1c375db-e541-416f-b983-9907ce4766f5 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:06.924949 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d1c375db-e541-416f-b983-9907ce4766f5 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:06.925385 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d1c375db-e541-416f-b983-9907ce4766f5 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:06.985476 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d1c375db-e541-416f-b983-9907ce4766f5 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:06.992752 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d1c375db-e541-416f-b983-9907ce4766f5 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9" status: 200 len: 1299 microversion: 2.1 time: 0.079620 Jun 16 12:30:06.993310 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 247/486] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:06 2022] GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9 => generated 1299 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:30:07.320414 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ccab9138-24f8-44fe-b0a3-4dbc864fd6e2 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:07.321137 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ccab9138-24f8-44fe-b0a3-4dbc864fd6e2 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:07.327772 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ccab9138-24f8-44fe-b0a3-4dbc864fd6e2 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:07.328298 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ccab9138-24f8-44fe-b0a3-4dbc864fd6e2 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:07.329172 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ccab9138-24f8-44fe-b0a3-4dbc864fd6e2 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:07.329609 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ccab9138-24f8-44fe-b0a3-4dbc864fd6e2 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:07.562506 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ccab9138-24f8-44fe-b0a3-4dbc864fd6e2 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:07.570450 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ccab9138-24f8-44fe-b0a3-4dbc864fd6e2 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:07.571959 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ccab9138-24f8-44fe-b0a3-4dbc864fd6e2 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:07.573660 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ccab9138-24f8-44fe-b0a3-4dbc864fd6e2 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1737 microversion: 2.20 time: 0.257033 Jun 16 12:30:07.574251 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 240/487] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:30:07 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1737 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:30:07.837837 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8f13aba9-e429-4847-b9df-adfff9ea377c tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:07.839409 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8f13aba9-e429-4847-b9df-adfff9ea377c tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] [instance: 6bc83901-92e8-41d6-836a-bf66159a61fe] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:07.847157 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8f13aba9-e429-4847-b9df-adfff9ea377c tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:07.847157 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8f13aba9-e429-4847-b9df-adfff9ea377c tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:07.847931 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8f13aba9-e429-4847-b9df-adfff9ea377c tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:07.848369 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8f13aba9-e429-4847-b9df-adfff9ea377c tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:07.852559 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:30:08.012743 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell0:SELECT=10 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:30:08.014345 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-afe3a417-8c9d-499b-945d-07ea4999c8a2 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:08.015350 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-afe3a417-8c9d-499b-945d-07ea4999c8a2 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9abc4b09-7cfc-47dc-b778-684eb2e331b9] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:08.024051 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-afe3a417-8c9d-499b-945d-07ea4999c8a2 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:08.025104 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-afe3a417-8c9d-499b-945d-07ea4999c8a2 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:08.026589 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-afe3a417-8c9d-499b-945d-07ea4999c8a2 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:08.027355 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-afe3a417-8c9d-499b-945d-07ea4999c8a2 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:08.129311 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8f13aba9-e429-4847-b9df-adfff9ea377c tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03828f516fce48d7b00b7027f6848190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10da9307eea6448ca287f557b450e3f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:08.143829 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8f13aba9-e429-4847-b9df-adfff9ea377c tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] 10.222.0.45 "GET /compute/v2.1/servers/6bc83901-92e8-41d6-836a-bf66159a61fe" status: 200 len: 1313 microversion: 2.1 time: 0.309885 Jun 16 12:30:08.144554 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 248/488] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:07 2022] GET /compute/v2.1/servers/6bc83901-92e8-41d6-836a-bf66159a61fe => generated 1313 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:30:08.219876 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-afe3a417-8c9d-499b-945d-07ea4999c8a2 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:08.231833 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-afe3a417-8c9d-499b-945d-07ea4999c8a2 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9" status: 200 len: 1367 microversion: 2.1 time: 0.223840 Jun 16 12:30:08.232495 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 241/489] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:08 2022] GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9 => generated 1367 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:30:08.592519 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ddb246fa-5774-4aa1-86f9-204d8639b617 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:08.595211 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ddb246fa-5774-4aa1-86f9-204d8639b617 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:08.601707 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ddb246fa-5774-4aa1-86f9-204d8639b617 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:08.602191 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ddb246fa-5774-4aa1-86f9-204d8639b617 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:08.602960 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ddb246fa-5774-4aa1-86f9-204d8639b617 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:08.603461 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ddb246fa-5774-4aa1-86f9-204d8639b617 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:08.655534 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-a3bf1e67-6819-4539-93c2-3cf81f268909 req-2b291c4c-19bc-4750-b45a-64069b61c54b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9abc4b09-7cfc-47dc-b778-684eb2e331b9", "tag": "00492cc8-699c-4660-9bfd-0cd1a05f4e44"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:30:08.666006 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-a3bf1e67-6819-4539-93c2-3cf81f268909 req-2b291c4c-19bc-4750-b45a-64069b61c54b service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:08.667778 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-a3bf1e67-6819-4539-93c2-3cf81f268909 req-2b291c4c-19bc-4750-b45a-64069b61c54b service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:08.684256 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-a3bf1e67-6819-4539-93c2-3cf81f268909 req-2b291c4c-19bc-4750-b45a-64069b61c54b service nova] Creating event network-changed:00492cc8-699c-4660-9bfd-0cd1a05f4e44 for instance 9abc4b09-7cfc-47dc-b778-684eb2e331b9 on hv-cinder-84614 Jun 16 12:30:08.690815 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-a3bf1e67-6819-4539-93c2-3cf81f268909 req-2b291c4c-19bc-4750-b45a-64069b61c54b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043277 Jun 16 12:30:08.691458 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 242/490] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:30:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 12:30:08.753137 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ddb246fa-5774-4aa1-86f9-204d8639b617 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:08.762524 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ddb246fa-5774-4aa1-86f9-204d8639b617 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:08.764075 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ddb246fa-5774-4aa1-86f9-204d8639b617 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:08.765277 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ddb246fa-5774-4aa1-86f9-204d8639b617 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1719 microversion: 2.20 time: 0.177456 Jun 16 12:30:08.765858 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 249/491] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:30:08 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1719 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:30:09.162786 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-474e245f-8c76-4ff6-a0e4-539b4f2b1592 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:09.163484 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-474e245f-8c76-4ff6-a0e4-539b4f2b1592 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] [instance: 6bc83901-92e8-41d6-836a-bf66159a61fe] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:09.169786 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-474e245f-8c76-4ff6-a0e4-539b4f2b1592 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:09.170260 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-474e245f-8c76-4ff6-a0e4-539b4f2b1592 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:09.171017 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-474e245f-8c76-4ff6-a0e4-539b4f2b1592 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:09.171459 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-474e245f-8c76-4ff6-a0e4-539b4f2b1592 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:09.249547 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a808bdca-af85-4c3f-95c9-b303f7655434 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:09.249975 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a808bdca-af85-4c3f-95c9-b303f7655434 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9abc4b09-7cfc-47dc-b778-684eb2e331b9] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:09.256064 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a808bdca-af85-4c3f-95c9-b303f7655434 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:09.256513 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a808bdca-af85-4c3f-95c9-b303f7655434 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:09.257275 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a808bdca-af85-4c3f-95c9-b303f7655434 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:09.257709 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a808bdca-af85-4c3f-95c9-b303f7655434 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:09.318046 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-474e245f-8c76-4ff6-a0e4-539b4f2b1592 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03828f516fce48d7b00b7027f6848190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10da9307eea6448ca287f557b450e3f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:09.326157 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-474e245f-8c76-4ff6-a0e4-539b4f2b1592 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] 10.222.0.45 "GET /compute/v2.1/servers/6bc83901-92e8-41d6-836a-bf66159a61fe" status: 200 len: 1313 microversion: 2.1 time: 0.168248 Jun 16 12:30:09.326719 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 243/492] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:09 2022] GET /compute/v2.1/servers/6bc83901-92e8-41d6-836a-bf66159a61fe => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:30:09.403237 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a808bdca-af85-4c3f-95c9-b303f7655434 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:09.410896 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a808bdca-af85-4c3f-95c9-b303f7655434 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9" status: 200 len: 1367 microversion: 2.1 time: 0.166231 Jun 16 12:30:09.411460 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 250/493] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:09 2022] GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:30:09.784831 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8df8bb66-88a7-4743-985e-7bb4f0aca4b1 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:09.785466 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8df8bb66-88a7-4743-985e-7bb4f0aca4b1 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:09.791933 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8df8bb66-88a7-4743-985e-7bb4f0aca4b1 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:09.792377 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8df8bb66-88a7-4743-985e-7bb4f0aca4b1 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:09.793131 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8df8bb66-88a7-4743-985e-7bb4f0aca4b1 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:09.793603 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8df8bb66-88a7-4743-985e-7bb4f0aca4b1 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:09.922465 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8df8bb66-88a7-4743-985e-7bb4f0aca4b1 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:09.930302 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8df8bb66-88a7-4743-985e-7bb4f0aca4b1 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:09.931850 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8df8bb66-88a7-4743-985e-7bb4f0aca4b1 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:09.933006 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8df8bb66-88a7-4743-985e-7bb4f0aca4b1 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1719 microversion: 2.20 time: 0.152357 Jun 16 12:30:09.933557 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 244/494] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:30:09 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1719 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:30:10.343408 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-53ed4412-befe-45f0-9d47-a57d53db941f tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:10.343946 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-53ed4412-befe-45f0-9d47-a57d53db941f tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] [instance: 6bc83901-92e8-41d6-836a-bf66159a61fe] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:10.350530 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-53ed4412-befe-45f0-9d47-a57d53db941f tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:10.350981 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-53ed4412-befe-45f0-9d47-a57d53db941f tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:10.351747 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-53ed4412-befe-45f0-9d47-a57d53db941f tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:10.352181 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-53ed4412-befe-45f0-9d47-a57d53db941f tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:10.427552 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-77c313f5-49d4-46e1-a672-39564a72a730 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:10.428250 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-77c313f5-49d4-46e1-a672-39564a72a730 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9abc4b09-7cfc-47dc-b778-684eb2e331b9] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:10.434908 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-77c313f5-49d4-46e1-a672-39564a72a730 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:10.435357 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-77c313f5-49d4-46e1-a672-39564a72a730 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:10.436115 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-77c313f5-49d4-46e1-a672-39564a72a730 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:10.436550 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-77c313f5-49d4-46e1-a672-39564a72a730 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:10.515489 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-53ed4412-befe-45f0-9d47-a57d53db941f tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03828f516fce48d7b00b7027f6848190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10da9307eea6448ca287f557b450e3f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:10.523165 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-53ed4412-befe-45f0-9d47-a57d53db941f tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] 10.222.0.45 "GET /compute/v2.1/servers/6bc83901-92e8-41d6-836a-bf66159a61fe" status: 200 len: 1313 microversion: 2.1 time: 0.183440 Jun 16 12:30:10.523526 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 251/495] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:10 2022] GET /compute/v2.1/servers/6bc83901-92e8-41d6-836a-bf66159a61fe => generated 1313 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:30:10.577008 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-77c313f5-49d4-46e1-a672-39564a72a730 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:10.584321 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-77c313f5-49d4-46e1-a672-39564a72a730 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9" status: 200 len: 1367 microversion: 2.1 time: 0.160976 Jun 16 12:30:10.584869 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 245/496] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:10 2022] GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:30:10.952150 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-dd4e8446-98a7-43ef-b85e-f91fd9e21e2c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:10.952749 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-dd4e8446-98a7-43ef-b85e-f91fd9e21e2c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:10.958706 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dd4e8446-98a7-43ef-b85e-f91fd9e21e2c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:10.959146 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dd4e8446-98a7-43ef-b85e-f91fd9e21e2c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:10.959892 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dd4e8446-98a7-43ef-b85e-f91fd9e21e2c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:10.960320 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dd4e8446-98a7-43ef-b85e-f91fd9e21e2c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:11.087362 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-dd4e8446-98a7-43ef-b85e-f91fd9e21e2c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:11.096343 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-dd4e8446-98a7-43ef-b85e-f91fd9e21e2c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:11.097825 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-dd4e8446-98a7-43ef-b85e-f91fd9e21e2c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:11.098987 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-dd4e8446-98a7-43ef-b85e-f91fd9e21e2c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1719 microversion: 2.20 time: 0.151920 Jun 16 12:30:11.099532 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 252/497] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:30:10 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1719 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:30:11.539961 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ef63ea6b-f62a-4a0c-aa69-464ccf47c9a8 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:11.540553 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ef63ea6b-f62a-4a0c-aa69-464ccf47c9a8 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] [instance: 6bc83901-92e8-41d6-836a-bf66159a61fe] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:11.542862 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=2 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:30:11.543579 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=10 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:30:11.544883 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:30:11.551422 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ef63ea6b-f62a-4a0c-aa69-464ccf47c9a8 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:11.551875 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ef63ea6b-f62a-4a0c-aa69-464ccf47c9a8 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:11.552644 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ef63ea6b-f62a-4a0c-aa69-464ccf47c9a8 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:11.553080 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ef63ea6b-f62a-4a0c-aa69-464ccf47c9a8 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:11.600749 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3acb2ec3-ca82-4fc1-9060-dd4c468611c6 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:11.601365 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3acb2ec3-ca82-4fc1-9060-dd4c468611c6 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9abc4b09-7cfc-47dc-b778-684eb2e331b9] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:11.607990 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3acb2ec3-ca82-4fc1-9060-dd4c468611c6 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:11.608379 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3acb2ec3-ca82-4fc1-9060-dd4c468611c6 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:11.609148 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3acb2ec3-ca82-4fc1-9060-dd4c468611c6 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:11.609585 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3acb2ec3-ca82-4fc1-9060-dd4c468611c6 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:11.729270 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ef63ea6b-f62a-4a0c-aa69-464ccf47c9a8 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03828f516fce48d7b00b7027f6848190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10da9307eea6448ca287f557b450e3f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:11.736912 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ef63ea6b-f62a-4a0c-aa69-464ccf47c9a8 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] 10.222.0.45 "GET /compute/v2.1/servers/6bc83901-92e8-41d6-836a-bf66159a61fe" status: 200 len: 1313 microversion: 2.1 time: 0.200681 Jun 16 12:30:11.737567 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 246/498] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:11 2022] GET /compute/v2.1/servers/6bc83901-92e8-41d6-836a-bf66159a61fe => generated 1313 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:30:11.772349 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-3acb2ec3-ca82-4fc1-9060-dd4c468611c6 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:11.779714 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3acb2ec3-ca82-4fc1-9060-dd4c468611c6 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9" status: 200 len: 1367 microversion: 2.1 time: 0.182788 Jun 16 12:30:11.780309 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 253/499] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:11 2022] GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9 => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:30:12.118035 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0ce08563-6925-4100-8ccb-34ac3cc88307 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:12.118649 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0ce08563-6925-4100-8ccb-34ac3cc88307 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:12.124970 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0ce08563-6925-4100-8ccb-34ac3cc88307 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:12.125422 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0ce08563-6925-4100-8ccb-34ac3cc88307 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:12.126210 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0ce08563-6925-4100-8ccb-34ac3cc88307 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:12.126652 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0ce08563-6925-4100-8ccb-34ac3cc88307 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:12.252318 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0ce08563-6925-4100-8ccb-34ac3cc88307 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:12.260175 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0ce08563-6925-4100-8ccb-34ac3cc88307 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:12.261830 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0ce08563-6925-4100-8ccb-34ac3cc88307 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:12.262991 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0ce08563-6925-4100-8ccb-34ac3cc88307 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1719 microversion: 2.20 time: 0.148914 Jun 16 12:30:12.263545 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 247/500] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:30:12 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1719 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:30:12.730356 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-52e89bb3-5d9f-465e-a238-06e42864891a req-d3f1ee2e-2ef3-4a7c-bba8-2fae632e7533 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bc83901-92e8-41d6-836a-bf66159a61fe", "name": "network-vif-plugged", "status": "completed", "tag": "c2d25ec4-314d-4236-8c08-702eec94ea43"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:30:12.739862 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-52e89bb3-5d9f-465e-a238-06e42864891a req-d3f1ee2e-2ef3-4a7c-bba8-2fae632e7533 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:12.740311 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-52e89bb3-5d9f-465e-a238-06e42864891a req-d3f1ee2e-2ef3-4a7c-bba8-2fae632e7533 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:12.754106 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-52e89bb3-5d9f-465e-a238-06e42864891a req-d3f1ee2e-2ef3-4a7c-bba8-2fae632e7533 service nova] Creating event network-vif-plugged:c2d25ec4-314d-4236-8c08-702eec94ea43 for instance 6bc83901-92e8-41d6-836a-bf66159a61fe on hv-cinder-84614 Jun 16 12:30:12.754614 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4be9ddcf-d2db-4b8f-89b0-95563f8c2312 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:12.755364 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4be9ddcf-d2db-4b8f-89b0-95563f8c2312 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] [instance: 6bc83901-92e8-41d6-836a-bf66159a61fe] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:12.759304 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-52e89bb3-5d9f-465e-a238-06e42864891a req-d3f1ee2e-2ef3-4a7c-bba8-2fae632e7533 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034294 Jun 16 12:30:12.760095 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 254/501] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:30:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:30:12.763622 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4be9ddcf-d2db-4b8f-89b0-95563f8c2312 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:12.764242 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4be9ddcf-d2db-4b8f-89b0-95563f8c2312 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:12.764852 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4be9ddcf-d2db-4b8f-89b0-95563f8c2312 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:12.765330 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4be9ddcf-d2db-4b8f-89b0-95563f8c2312 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:12.770379 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:30:12.804219 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-bf975989-0fd1-45c0-87e5-23b839dc3d0e tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:12.804854 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-bf975989-0fd1-45c0-87e5-23b839dc3d0e tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9abc4b09-7cfc-47dc-b778-684eb2e331b9] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:12.812242 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bf975989-0fd1-45c0-87e5-23b839dc3d0e tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:12.812732 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bf975989-0fd1-45c0-87e5-23b839dc3d0e tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:12.813508 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bf975989-0fd1-45c0-87e5-23b839dc3d0e tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:12.814030 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bf975989-0fd1-45c0-87e5-23b839dc3d0e tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:12.950132 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4be9ddcf-d2db-4b8f-89b0-95563f8c2312 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03828f516fce48d7b00b7027f6848190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10da9307eea6448ca287f557b450e3f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:12.957517 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4be9ddcf-d2db-4b8f-89b0-95563f8c2312 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] 10.222.0.45 "GET /compute/v2.1/servers/6bc83901-92e8-41d6-836a-bf66159a61fe" status: 200 len: 1313 microversion: 2.1 time: 0.206756 Jun 16 12:30:12.958118 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 248/502] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:12 2022] GET /compute/v2.1/servers/6bc83901-92e8-41d6-836a-bf66159a61fe => generated 1313 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:30:12.979810 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-bf975989-0fd1-45c0-87e5-23b839dc3d0e tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:12.987293 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-bf975989-0fd1-45c0-87e5-23b839dc3d0e tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9" status: 200 len: 1367 microversion: 2.1 time: 0.187411 Jun 16 12:30:12.987857 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 255/503] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:12 2022] GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9 => generated 1367 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:30:13.281531 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ca0d198c-622a-45ad-8f3a-f7895a47fda9 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:13.282167 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ca0d198c-622a-45ad-8f3a-f7895a47fda9 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:13.288371 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ca0d198c-622a-45ad-8f3a-f7895a47fda9 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:13.288819 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ca0d198c-622a-45ad-8f3a-f7895a47fda9 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:13.289570 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ca0d198c-622a-45ad-8f3a-f7895a47fda9 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:13.290037 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ca0d198c-622a-45ad-8f3a-f7895a47fda9 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:13.418801 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ca0d198c-622a-45ad-8f3a-f7895a47fda9 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:13.426976 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ca0d198c-622a-45ad-8f3a-f7895a47fda9 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:13.428484 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ca0d198c-622a-45ad-8f3a-f7895a47fda9 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:13.429629 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ca0d198c-622a-45ad-8f3a-f7895a47fda9 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1719 microversion: 2.20 time: 0.151967 Jun 16 12:30:13.430221 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 249/504] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:30:13 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1719 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:30:13.974763 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-cbe23c69-4246-4887-825f-d6340d8c6599 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:13.975379 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-cbe23c69-4246-4887-825f-d6340d8c6599 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] [instance: 6bc83901-92e8-41d6-836a-bf66159a61fe] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:13.982425 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cbe23c69-4246-4887-825f-d6340d8c6599 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:13.982878 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cbe23c69-4246-4887-825f-d6340d8c6599 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:13.983640 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cbe23c69-4246-4887-825f-d6340d8c6599 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:13.984078 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cbe23c69-4246-4887-825f-d6340d8c6599 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:14.004039 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-479024b0-3427-4690-bffb-63341bf79cea tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:14.004954 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-479024b0-3427-4690-bffb-63341bf79cea tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9abc4b09-7cfc-47dc-b778-684eb2e331b9] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:14.014448 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-479024b0-3427-4690-bffb-63341bf79cea tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:14.015349 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-479024b0-3427-4690-bffb-63341bf79cea tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:14.016450 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-479024b0-3427-4690-bffb-63341bf79cea tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:14.017197 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-479024b0-3427-4690-bffb-63341bf79cea tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:14.198978 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-cbe23c69-4246-4887-825f-d6340d8c6599 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03828f516fce48d7b00b7027f6848190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10da9307eea6448ca287f557b450e3f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:14.207710 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-cbe23c69-4246-4887-825f-d6340d8c6599 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] 10.222.0.45 "GET /compute/v2.1/servers/6bc83901-92e8-41d6-836a-bf66159a61fe" status: 200 len: 1313 microversion: 2.1 time: 0.236698 Jun 16 12:30:14.209073 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 256/505] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:13 2022] GET /compute/v2.1/servers/6bc83901-92e8-41d6-836a-bf66159a61fe => generated 1313 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:30:14.237247 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-479024b0-3427-4690-bffb-63341bf79cea tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:14.244962 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-479024b0-3427-4690-bffb-63341bf79cea tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9" status: 200 len: 1367 microversion: 2.1 time: 0.244692 Jun 16 12:30:14.245537 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 250/506] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:13 2022] GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9 => generated 1367 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:30:14.448152 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4fb280ed-c021-4563-854a-b682ea4b0e9f tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:14.448753 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4fb280ed-c021-4563-854a-b682ea4b0e9f tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:14.455045 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4fb280ed-c021-4563-854a-b682ea4b0e9f tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:14.455489 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4fb280ed-c021-4563-854a-b682ea4b0e9f tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:14.456233 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4fb280ed-c021-4563-854a-b682ea4b0e9f tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:14.456660 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4fb280ed-c021-4563-854a-b682ea4b0e9f tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:14.581992 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4fb280ed-c021-4563-854a-b682ea4b0e9f tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:14.590217 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4fb280ed-c021-4563-854a-b682ea4b0e9f tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:14.591706 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4fb280ed-c021-4563-854a-b682ea4b0e9f tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:14.592837 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4fb280ed-c021-4563-854a-b682ea4b0e9f tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1719 microversion: 2.20 time: 0.148844 Jun 16 12:30:14.593383 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 257/507] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:30:14 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1719 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:30:15.225393 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9050330a-26a0-4909-a0e1-7c5b8e2389ee tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:15.226031 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9050330a-26a0-4909-a0e1-7c5b8e2389ee tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] [instance: 6bc83901-92e8-41d6-836a-bf66159a61fe] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:15.232960 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9050330a-26a0-4909-a0e1-7c5b8e2389ee tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:15.233404 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9050330a-26a0-4909-a0e1-7c5b8e2389ee tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:15.234292 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9050330a-26a0-4909-a0e1-7c5b8e2389ee tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:15.234725 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9050330a-26a0-4909-a0e1-7c5b8e2389ee tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:15.260959 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-95e6ac94-b517-49cd-8e79-0357d0692c27 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:15.261565 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-95e6ac94-b517-49cd-8e79-0357d0692c27 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9abc4b09-7cfc-47dc-b778-684eb2e331b9] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:15.268052 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-95e6ac94-b517-49cd-8e79-0357d0692c27 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:15.268504 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-95e6ac94-b517-49cd-8e79-0357d0692c27 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:15.269263 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-95e6ac94-b517-49cd-8e79-0357d0692c27 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:15.269701 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-95e6ac94-b517-49cd-8e79-0357d0692c27 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:15.424302 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9050330a-26a0-4909-a0e1-7c5b8e2389ee tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03828f516fce48d7b00b7027f6848190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10da9307eea6448ca287f557b450e3f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:15.432221 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9050330a-26a0-4909-a0e1-7c5b8e2389ee tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] 10.222.0.45 "GET /compute/v2.1/servers/6bc83901-92e8-41d6-836a-bf66159a61fe" status: 200 len: 1313 microversion: 2.1 time: 0.210045 Jun 16 12:30:15.432891 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 251/508] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:15 2022] GET /compute/v2.1/servers/6bc83901-92e8-41d6-836a-bf66159a61fe => generated 1313 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:30:15.446026 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-95e6ac94-b517-49cd-8e79-0357d0692c27 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:15.453943 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-95e6ac94-b517-49cd-8e79-0357d0692c27 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9" status: 200 len: 1367 microversion: 2.1 time: 0.197338 Jun 16 12:30:15.454502 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 258/509] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:15 2022] GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9 => generated 1367 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:30:15.610447 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-bf49bf2a-3fc2-47b3-ab57-9015a6a1e531 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:15.610971 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-bf49bf2a-3fc2-47b3-ab57-9015a6a1e531 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:15.616897 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bf49bf2a-3fc2-47b3-ab57-9015a6a1e531 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:15.617344 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bf49bf2a-3fc2-47b3-ab57-9015a6a1e531 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:15.618135 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bf49bf2a-3fc2-47b3-ab57-9015a6a1e531 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:15.618573 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bf49bf2a-3fc2-47b3-ab57-9015a6a1e531 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:15.746084 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-bf49bf2a-3fc2-47b3-ab57-9015a6a1e531 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:15.753908 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-bf49bf2a-3fc2-47b3-ab57-9015a6a1e531 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:15.755414 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-bf49bf2a-3fc2-47b3-ab57-9015a6a1e531 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:15.756572 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-bf49bf2a-3fc2-47b3-ab57-9015a6a1e531 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1719 microversion: 2.20 time: 0.150026 Jun 16 12:30:15.757125 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 252/510] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:30:15 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1719 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:30:16.449181 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-bb863474-3553-4488-97f7-39774d5a1526 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:16.449784 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-bb863474-3553-4488-97f7-39774d5a1526 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] [instance: 6bc83901-92e8-41d6-836a-bf66159a61fe] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:16.456238 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bb863474-3553-4488-97f7-39774d5a1526 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:16.456681 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bb863474-3553-4488-97f7-39774d5a1526 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:16.457427 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bb863474-3553-4488-97f7-39774d5a1526 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:16.457859 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bb863474-3553-4488-97f7-39774d5a1526 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:16.470653 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c26f0c7a-7d56-4aae-916e-44371a940b32 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:16.471274 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c26f0c7a-7d56-4aae-916e-44371a940b32 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9abc4b09-7cfc-47dc-b778-684eb2e331b9] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:16.477714 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c26f0c7a-7d56-4aae-916e-44371a940b32 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:16.478205 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c26f0c7a-7d56-4aae-916e-44371a940b32 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:16.479856 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c26f0c7a-7d56-4aae-916e-44371a940b32 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:16.480293 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c26f0c7a-7d56-4aae-916e-44371a940b32 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:16.652950 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-bb863474-3553-4488-97f7-39774d5a1526 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03828f516fce48d7b00b7027f6848190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10da9307eea6448ca287f557b450e3f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:16.659415 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c26f0c7a-7d56-4aae-916e-44371a940b32 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:16.660970 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-bb863474-3553-4488-97f7-39774d5a1526 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] 10.222.0.45 "GET /compute/v2.1/servers/6bc83901-92e8-41d6-836a-bf66159a61fe" status: 200 len: 1313 microversion: 2.1 time: 0.216200 Jun 16 12:30:16.661545 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 259/511] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:16 2022] GET /compute/v2.1/servers/6bc83901-92e8-41d6-836a-bf66159a61fe => generated 1313 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:30:16.667585 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c26f0c7a-7d56-4aae-916e-44371a940b32 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9" status: 200 len: 1367 microversion: 2.1 time: 0.200663 Jun 16 12:30:16.668132 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 253/512] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:16 2022] GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9 => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:30:16.777075 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f9dd0363-2426-4456-93bd-4d8d89dbf3d2 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:16.777686 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f9dd0363-2426-4456-93bd-4d8d89dbf3d2 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:16.783921 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f9dd0363-2426-4456-93bd-4d8d89dbf3d2 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:16.784368 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f9dd0363-2426-4456-93bd-4d8d89dbf3d2 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:16.785120 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f9dd0363-2426-4456-93bd-4d8d89dbf3d2 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:16.785550 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f9dd0363-2426-4456-93bd-4d8d89dbf3d2 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:16.912647 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f9dd0363-2426-4456-93bd-4d8d89dbf3d2 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:16.921259 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f9dd0363-2426-4456-93bd-4d8d89dbf3d2 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:16.922812 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f9dd0363-2426-4456-93bd-4d8d89dbf3d2 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:16.924087 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f9dd0363-2426-4456-93bd-4d8d89dbf3d2 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1719 microversion: 2.20 time: 0.152354 Jun 16 12:30:16.924653 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 260/513] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:30:16 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1719 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:30:17.678358 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b882bbf2-3f11-4b6b-ba1a-bb9a288037ff tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:17.678986 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b882bbf2-3f11-4b6b-ba1a-bb9a288037ff tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] [instance: 6bc83901-92e8-41d6-836a-bf66159a61fe] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:17.683992 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1d286f93-7c47-4db8-b9ef-66f160404960 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:17.684632 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1d286f93-7c47-4db8-b9ef-66f160404960 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9abc4b09-7cfc-47dc-b778-684eb2e331b9] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:17.685525 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b882bbf2-3f11-4b6b-ba1a-bb9a288037ff tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:17.686025 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b882bbf2-3f11-4b6b-ba1a-bb9a288037ff tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:17.686801 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b882bbf2-3f11-4b6b-ba1a-bb9a288037ff tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:17.687244 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b882bbf2-3f11-4b6b-ba1a-bb9a288037ff tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:17.690959 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1d286f93-7c47-4db8-b9ef-66f160404960 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:17.691403 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1d286f93-7c47-4db8-b9ef-66f160404960 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:17.692152 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1d286f93-7c47-4db8-b9ef-66f160404960 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:17.692583 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1d286f93-7c47-4db8-b9ef-66f160404960 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:17.880468 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b882bbf2-3f11-4b6b-ba1a-bb9a288037ff tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03828f516fce48d7b00b7027f6848190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10da9307eea6448ca287f557b450e3f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:17.884067 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1d286f93-7c47-4db8-b9ef-66f160404960 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:17.892285 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1d286f93-7c47-4db8-b9ef-66f160404960 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9" status: 200 len: 1367 microversion: 2.1 time: 0.212061 Jun 16 12:30:17.892429 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b882bbf2-3f11-4b6b-ba1a-bb9a288037ff tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] 10.222.0.45 "GET /compute/v2.1/servers/6bc83901-92e8-41d6-836a-bf66159a61fe" status: 200 len: 1313 microversion: 2.1 time: 0.217854 Jun 16 12:30:17.892851 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 261/514] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:17 2022] GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9 => generated 1367 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:30:17.896210 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 254/515] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:17 2022] GET /compute/v2.1/servers/6bc83901-92e8-41d6-836a-bf66159a61fe => generated 1313 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:30:17.942021 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0e5ef8e9-08cd-44c2-9fc2-6e2ec01340d5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:17.942556 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0e5ef8e9-08cd-44c2-9fc2-6e2ec01340d5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:17.949273 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0e5ef8e9-08cd-44c2-9fc2-6e2ec01340d5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:17.949714 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0e5ef8e9-08cd-44c2-9fc2-6e2ec01340d5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:17.950506 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0e5ef8e9-08cd-44c2-9fc2-6e2ec01340d5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:17.950942 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0e5ef8e9-08cd-44c2-9fc2-6e2ec01340d5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:18.079966 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0e5ef8e9-08cd-44c2-9fc2-6e2ec01340d5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:18.088438 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0e5ef8e9-08cd-44c2-9fc2-6e2ec01340d5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:18.089982 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0e5ef8e9-08cd-44c2-9fc2-6e2ec01340d5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:18.091125 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0e5ef8e9-08cd-44c2-9fc2-6e2ec01340d5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1719 microversion: 2.20 time: 0.152978 Jun 16 12:30:18.091692 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 262/516] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:30:17 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1719 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:30:18.813108 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-d6ad1abd-4236-4b6c-82e8-94a8966b988f req-7a4498bd-81bc-4b25-9d8f-289723faf3f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8528919e-1e7a-4807-9b11-ae225e65d4df", "name": "network-vif-unplugged", "status": "completed", "tag": "ee66a439-1483-44c8-a66e-9b4920bb00e9"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:30:18.823144 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-d6ad1abd-4236-4b6c-82e8-94a8966b988f req-7a4498bd-81bc-4b25-9d8f-289723faf3f0 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:18.823691 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-d6ad1abd-4236-4b6c-82e8-94a8966b988f req-7a4498bd-81bc-4b25-9d8f-289723faf3f0 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:18.835164 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-d6ad1abd-4236-4b6c-82e8-94a8966b988f req-7a4498bd-81bc-4b25-9d8f-289723faf3f0 service nova] Creating event network-vif-unplugged:ee66a439-1483-44c8-a66e-9b4920bb00e9 for instance 8528919e-1e7a-4807-9b11-ae225e65d4df on hv-cinder-84614 Jun 16 12:30:18.841294 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-d6ad1abd-4236-4b6c-82e8-94a8966b988f req-7a4498bd-81bc-4b25-9d8f-289723faf3f0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031724 Jun 16 12:30:18.841914 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 255/517] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:30:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:30:18.909030 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8c2218a5-0084-40e1-beaa-7a45c7ab39ec tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:18.909553 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7dc31835-cd82-46c4-b2b9-65d7a68e9297 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:18.910122 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7dc31835-cd82-46c4-b2b9-65d7a68e9297 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] [instance: 6bc83901-92e8-41d6-836a-bf66159a61fe] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:18.910467 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8c2218a5-0084-40e1-beaa-7a45c7ab39ec tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9abc4b09-7cfc-47dc-b778-684eb2e331b9] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:18.917911 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8c2218a5-0084-40e1-beaa-7a45c7ab39ec tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:18.918049 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7dc31835-cd82-46c4-b2b9-65d7a68e9297 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:18.918363 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8c2218a5-0084-40e1-beaa-7a45c7ab39ec tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:18.918469 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7dc31835-cd82-46c4-b2b9-65d7a68e9297 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:18.919121 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8c2218a5-0084-40e1-beaa-7a45c7ab39ec tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:18.919239 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7dc31835-cd82-46c4-b2b9-65d7a68e9297 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:18.919550 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8c2218a5-0084-40e1-beaa-7a45c7ab39ec tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:18.919674 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7dc31835-cd82-46c4-b2b9-65d7a68e9297 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:19.113502 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8c2218a5-0084-40e1-beaa-7a45c7ab39ec tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:19.122205 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8c2218a5-0084-40e1-beaa-7a45c7ab39ec tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9" status: 200 len: 1367 microversion: 2.1 time: 0.217339 Jun 16 12:30:19.122784 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 263/518] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:18 2022] GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9 => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:30:19.126016 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7dc31835-cd82-46c4-b2b9-65d7a68e9297 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03828f516fce48d7b00b7027f6848190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10da9307eea6448ca287f557b450e3f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:19.127874 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-10b9455b-d74d-4245-a2d9-54883b0ab0c4 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:19.128546 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-10b9455b-d74d-4245-a2d9-54883b0ab0c4 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:19.134643 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7dc31835-cd82-46c4-b2b9-65d7a68e9297 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] 10.222.0.45 "GET /compute/v2.1/servers/6bc83901-92e8-41d6-836a-bf66159a61fe" status: 200 len: 1313 microversion: 2.1 time: 0.229767 Jun 16 12:30:19.135478 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 256/519] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:18 2022] GET /compute/v2.1/servers/6bc83901-92e8-41d6-836a-bf66159a61fe => generated 1313 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:30:19.136919 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-10b9455b-d74d-4245-a2d9-54883b0ab0c4 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:19.137376 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-10b9455b-d74d-4245-a2d9-54883b0ab0c4 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:19.138185 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-10b9455b-d74d-4245-a2d9-54883b0ab0c4 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:19.138627 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-10b9455b-d74d-4245-a2d9-54883b0ab0c4 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:19.274505 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-10b9455b-d74d-4245-a2d9-54883b0ab0c4 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:19.283655 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-10b9455b-d74d-4245-a2d9-54883b0ab0c4 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:19.285144 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-10b9455b-d74d-4245-a2d9-54883b0ab0c4 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:19.286369 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-10b9455b-d74d-4245-a2d9-54883b0ab0c4 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1719 microversion: 2.20 time: 0.162506 Jun 16 12:30:19.286936 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 264/520] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:30:19 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1719 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:30:20.138549 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-db8c7f79-4402-4a4e-b81b-f4f93e745135 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:20.139159 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-db8c7f79-4402-4a4e-b81b-f4f93e745135 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9abc4b09-7cfc-47dc-b778-684eb2e331b9] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:20.146291 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-db8c7f79-4402-4a4e-b81b-f4f93e745135 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:20.146746 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-db8c7f79-4402-4a4e-b81b-f4f93e745135 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:20.147524 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-db8c7f79-4402-4a4e-b81b-f4f93e745135 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:20.147957 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-db8c7f79-4402-4a4e-b81b-f4f93e745135 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:20.152620 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6cbdbe01-3571-4512-9c74-67e847658f0c tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:20.153231 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6cbdbe01-3571-4512-9c74-67e847658f0c tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] [instance: 6bc83901-92e8-41d6-836a-bf66159a61fe] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:20.160030 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6cbdbe01-3571-4512-9c74-67e847658f0c tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:20.160704 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6cbdbe01-3571-4512-9c74-67e847658f0c tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:20.161483 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6cbdbe01-3571-4512-9c74-67e847658f0c tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:20.162051 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6cbdbe01-3571-4512-9c74-67e847658f0c tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:20.181376 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:30:20.380186 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-db8c7f79-4402-4a4e-b81b-f4f93e745135 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:20.383055 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6cbdbe01-3571-4512-9c74-67e847658f0c tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03828f516fce48d7b00b7027f6848190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10da9307eea6448ca287f557b450e3f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:20.388815 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-db8c7f79-4402-4a4e-b81b-f4f93e745135 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9" status: 200 len: 1367 microversion: 2.1 time: 0.253980 Jun 16 12:30:20.389382 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 257/521] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:20 2022] GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9 => generated 1367 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:30:20.398125 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6cbdbe01-3571-4512-9c74-67e847658f0c tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] 10.222.0.45 "GET /compute/v2.1/servers/6bc83901-92e8-41d6-836a-bf66159a61fe" status: 200 len: 1313 microversion: 2.1 time: 0.243136 Jun 16 12:30:20.398125 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 265/522] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:20 2022] GET /compute/v2.1/servers/6bc83901-92e8-41d6-836a-bf66159a61fe => generated 1313 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:30:20.398356 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-064f94c2-5263-407e-9d0f-afab9f3f045b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:20.398356 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-064f94c2-5263-407e-9d0f-afab9f3f045b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:20.400562 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-064f94c2-5263-407e-9d0f-afab9f3f045b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:20.401081 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-064f94c2-5263-407e-9d0f-afab9f3f045b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:20.401833 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-064f94c2-5263-407e-9d0f-afab9f3f045b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:20.402300 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-064f94c2-5263-407e-9d0f-afab9f3f045b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:20.529998 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-064f94c2-5263-407e-9d0f-afab9f3f045b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:20.538050 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-064f94c2-5263-407e-9d0f-afab9f3f045b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:20.539547 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-064f94c2-5263-407e-9d0f-afab9f3f045b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:20.540709 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-064f94c2-5263-407e-9d0f-afab9f3f045b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1722 microversion: 2.20 time: 0.150367 Jun 16 12:30:20.541324 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 258/523] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:30:20 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:30:20.558410 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-cd4d0af4-bbcd-4564-92a0-827645ca4e3b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b9aa6bfb-3275-406b-b8a2-ee31f3e96ff1"}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:30:20.559537 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-cd4d0af4-bbcd-4564-92a0-827645ca4e3b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:20.565392 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cd4d0af4-bbcd-4564-92a0-827645ca4e3b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:20.565828 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cd4d0af4-bbcd-4564-92a0-827645ca4e3b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:20.566617 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cd4d0af4-bbcd-4564-92a0-827645ca4e3b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:20.567049 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cd4d0af4-bbcd-4564-92a0-827645ca4e3b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:20.870292 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-cd4d0af4-bbcd-4564-92a0-827645ca4e3b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "POST /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.316315 Jun 16 12:30:20.870891 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 266/524] 10.222.0.45 () {62 vars in 1363 bytes} [Thu Jun 16 12:30:20 2022] POST /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df/os-volume_attachments => generated 188 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 12:30:20.983106 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b3dede06-34ca-4fed-a836-28db2aa93921 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:30:20.983659 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b3dede06-34ca-4fed-a836-28db2aa93921 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:20.989640 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b3dede06-34ca-4fed-a836-28db2aa93921 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:20.990134 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b3dede06-34ca-4fed-a836-28db2aa93921 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:20.990895 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b3dede06-34ca-4fed-a836-28db2aa93921 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:20.991332 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b3dede06-34ca-4fed-a836-28db2aa93921 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:21.078925 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b3dede06-34ca-4fed-a836-28db2aa93921 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "POST /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df/action" status: 202 len: 0 microversion: 2.20 time: 0.100354 Jun 16 12:30:21.079885 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 259/525] 10.222.0.45 () {62 vars in 1318 bytes} [Thu Jun 16 12:30:20 2022] POST /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 12:30:21.088600 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-36a1b734-f6d8-4c9e-81e7-5722aadda093 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:21.089298 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-36a1b734-f6d8-4c9e-81e7-5722aadda093 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:21.101280 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-36a1b734-f6d8-4c9e-81e7-5722aadda093 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:21.101727 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-36a1b734-f6d8-4c9e-81e7-5722aadda093 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:21.102516 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-36a1b734-f6d8-4c9e-81e7-5722aadda093 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:21.102945 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-36a1b734-f6d8-4c9e-81e7-5722aadda093 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:21.239891 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-36a1b734-f6d8-4c9e-81e7-5722aadda093 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:21.248299 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-36a1b734-f6d8-4c9e-81e7-5722aadda093 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:21.250051 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-36a1b734-f6d8-4c9e-81e7-5722aadda093 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:21.251209 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-36a1b734-f6d8-4c9e-81e7-5722aadda093 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1748 microversion: 2.20 time: 0.167348 Jun 16 12:30:21.251765 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 267/526] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:30:21 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1748 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:30:21.406845 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-23c08694-f630-4d3f-927a-ad81e7b217e1 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:21.407405 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-eb09344d-3787-4272-ad20-4a32d6d56270 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:21.407731 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-eb09344d-3787-4272-ad20-4a32d6d56270 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] [instance: 6bc83901-92e8-41d6-836a-bf66159a61fe] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:21.408708 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-23c08694-f630-4d3f-927a-ad81e7b217e1 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9abc4b09-7cfc-47dc-b778-684eb2e331b9] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:21.414855 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-eb09344d-3787-4272-ad20-4a32d6d56270 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:21.415310 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-eb09344d-3787-4272-ad20-4a32d6d56270 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:21.415676 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-23c08694-f630-4d3f-927a-ad81e7b217e1 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:21.416653 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-eb09344d-3787-4272-ad20-4a32d6d56270 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:21.416763 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-23c08694-f630-4d3f-927a-ad81e7b217e1 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:21.417100 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-eb09344d-3787-4272-ad20-4a32d6d56270 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:21.417520 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-23c08694-f630-4d3f-927a-ad81e7b217e1 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:21.418119 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-23c08694-f630-4d3f-927a-ad81e7b217e1 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:21.618563 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-eb09344d-3787-4272-ad20-4a32d6d56270 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03828f516fce48d7b00b7027f6848190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10da9307eea6448ca287f557b450e3f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:21.622301 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-23c08694-f630-4d3f-927a-ad81e7b217e1 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:21.626628 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-eb09344d-3787-4272-ad20-4a32d6d56270 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] 10.222.0.45 "GET /compute/v2.1/servers/6bc83901-92e8-41d6-836a-bf66159a61fe" status: 200 len: 1497 microversion: 2.1 time: 0.223191 Jun 16 12:30:21.627307 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 268/527] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:21 2022] GET /compute/v2.1/servers/6bc83901-92e8-41d6-836a-bf66159a61fe => generated 1497 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:30:21.630318 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-23c08694-f630-4d3f-927a-ad81e7b217e1 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9" status: 200 len: 1367 microversion: 2.1 time: 0.228022 Jun 16 12:30:21.630877 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 260/528] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:21 2022] GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9 => generated 1367 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:30:22.269473 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ca9d2a1c-2668-43e6-a244-f0fe1262e036 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:22.270107 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ca9d2a1c-2668-43e6-a244-f0fe1262e036 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:22.277281 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ca9d2a1c-2668-43e6-a244-f0fe1262e036 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:22.277730 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ca9d2a1c-2668-43e6-a244-f0fe1262e036 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:22.278510 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ca9d2a1c-2668-43e6-a244-f0fe1262e036 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:22.278946 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ca9d2a1c-2668-43e6-a244-f0fe1262e036 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:22.407050 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ca9d2a1c-2668-43e6-a244-f0fe1262e036 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:22.415579 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ca9d2a1c-2668-43e6-a244-f0fe1262e036 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:22.417117 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ca9d2a1c-2668-43e6-a244-f0fe1262e036 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:22.418330 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ca9d2a1c-2668-43e6-a244-f0fe1262e036 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1748 microversion: 2.20 time: 0.152745 Jun 16 12:30:22.418880 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 269/529] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:30:22 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1748 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 12:30:22.647594 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-08b7ac2a-66eb-4516-97bf-456ec80641bd tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:22.648206 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-08b7ac2a-66eb-4516-97bf-456ec80641bd tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9abc4b09-7cfc-47dc-b778-684eb2e331b9] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:22.654709 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-08b7ac2a-66eb-4516-97bf-456ec80641bd tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:22.655160 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-08b7ac2a-66eb-4516-97bf-456ec80641bd tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:22.655921 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-08b7ac2a-66eb-4516-97bf-456ec80641bd tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:22.656383 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-08b7ac2a-66eb-4516-97bf-456ec80641bd tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:22.789129 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-08b7ac2a-66eb-4516-97bf-456ec80641bd tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:22.797255 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-08b7ac2a-66eb-4516-97bf-456ec80641bd tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9" status: 200 len: 1367 microversion: 2.1 time: 0.153533 Jun 16 12:30:22.797819 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 261/530] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:22 2022] GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:30:23.436392 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-af18860d-2e08-451b-a27f-20411b82d7a8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:23.437027 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-af18860d-2e08-451b-a27f-20411b82d7a8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:23.443595 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-af18860d-2e08-451b-a27f-20411b82d7a8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:23.444038 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-af18860d-2e08-451b-a27f-20411b82d7a8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:23.444790 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-af18860d-2e08-451b-a27f-20411b82d7a8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:23.445217 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-af18860d-2e08-451b-a27f-20411b82d7a8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:23.571756 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-af18860d-2e08-451b-a27f-20411b82d7a8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:23.580576 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-af18860d-2e08-451b-a27f-20411b82d7a8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:23.582096 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-af18860d-2e08-451b-a27f-20411b82d7a8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:23.583241 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-af18860d-2e08-451b-a27f-20411b82d7a8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1748 microversion: 2.20 time: 0.150681 Jun 16 12:30:23.583800 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 270/531] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:30:23 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1748 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:30:23.812733 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d893d7a8-ba56-4298-9d60-97b0605cc725 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:23.813344 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d893d7a8-ba56-4298-9d60-97b0605cc725 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9abc4b09-7cfc-47dc-b778-684eb2e331b9] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:23.819854 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d893d7a8-ba56-4298-9d60-97b0605cc725 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:23.820298 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d893d7a8-ba56-4298-9d60-97b0605cc725 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:23.821048 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d893d7a8-ba56-4298-9d60-97b0605cc725 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:23.821478 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d893d7a8-ba56-4298-9d60-97b0605cc725 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:23.949172 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d893d7a8-ba56-4298-9d60-97b0605cc725 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:23.960132 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d893d7a8-ba56-4298-9d60-97b0605cc725 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9" status: 200 len: 1367 microversion: 2.1 time: 0.151226 Jun 16 12:30:23.960704 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 262/532] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:23 2022] GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:30:24.600943 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-47f1a08b-438e-43c0-be31-2337146d2fa2 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:24.601547 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-47f1a08b-438e-43c0-be31-2337146d2fa2 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:24.608702 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-47f1a08b-438e-43c0-be31-2337146d2fa2 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:24.609087 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-47f1a08b-438e-43c0-be31-2337146d2fa2 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:24.609843 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-47f1a08b-438e-43c0-be31-2337146d2fa2 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:24.610303 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-47f1a08b-438e-43c0-be31-2337146d2fa2 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:24.752417 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-47f1a08b-438e-43c0-be31-2337146d2fa2 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:24.763366 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-47f1a08b-438e-43c0-be31-2337146d2fa2 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:24.764899 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-47f1a08b-438e-43c0-be31-2337146d2fa2 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:24.766090 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-47f1a08b-438e-43c0-be31-2337146d2fa2 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1748 microversion: 2.20 time: 0.169036 Jun 16 12:30:24.766646 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 271/533] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:30:24 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1748 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:30:24.976489 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ef94dc0a-6870-4fe2-810d-46e8eeecea27 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:24.977094 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ef94dc0a-6870-4fe2-810d-46e8eeecea27 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9abc4b09-7cfc-47dc-b778-684eb2e331b9] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:24.984671 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ef94dc0a-6870-4fe2-810d-46e8eeecea27 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:24.985115 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ef94dc0a-6870-4fe2-810d-46e8eeecea27 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:24.985879 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ef94dc0a-6870-4fe2-810d-46e8eeecea27 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:24.986322 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ef94dc0a-6870-4fe2-810d-46e8eeecea27 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:25.115776 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ef94dc0a-6870-4fe2-810d-46e8eeecea27 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:25.123163 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ef94dc0a-6870-4fe2-810d-46e8eeecea27 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9" status: 200 len: 1367 microversion: 2.1 time: 0.150497 Jun 16 12:30:25.123722 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 263/534] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:24 2022] GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:30:25.784937 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ad322dcf-e2be-4154-aff0-cffb9da00458 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:25.785637 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ad322dcf-e2be-4154-aff0-cffb9da00458 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:25.792198 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ad322dcf-e2be-4154-aff0-cffb9da00458 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:25.792681 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ad322dcf-e2be-4154-aff0-cffb9da00458 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:25.793476 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ad322dcf-e2be-4154-aff0-cffb9da00458 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:25.793948 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ad322dcf-e2be-4154-aff0-cffb9da00458 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:25.923623 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ad322dcf-e2be-4154-aff0-cffb9da00458 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:25.932659 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ad322dcf-e2be-4154-aff0-cffb9da00458 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:25.934211 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ad322dcf-e2be-4154-aff0-cffb9da00458 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:25.935360 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ad322dcf-e2be-4154-aff0-cffb9da00458 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1748 microversion: 2.20 time: 0.154575 Jun 16 12:30:25.935921 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 272/535] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:30:25 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1748 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:30:26.142215 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d6d93039-21e2-4fc9-b17a-6269b90936fc tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:26.142976 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d6d93039-21e2-4fc9-b17a-6269b90936fc tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9abc4b09-7cfc-47dc-b778-684eb2e331b9] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:26.148964 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d6d93039-21e2-4fc9-b17a-6269b90936fc tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:26.149420 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d6d93039-21e2-4fc9-b17a-6269b90936fc tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:26.150243 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d6d93039-21e2-4fc9-b17a-6269b90936fc tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:26.150934 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d6d93039-21e2-4fc9-b17a-6269b90936fc tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:26.171936 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:30:26.194471 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-dc5cdd4d-b5a4-4397-a275-8ac2a0433e57 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:26.194960 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-dc5cdd4d-b5a4-4397-a275-8ac2a0433e57 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] [instance: 6bc83901-92e8-41d6-836a-bf66159a61fe] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:26.201177 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dc5cdd4d-b5a4-4397-a275-8ac2a0433e57 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:26.201661 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dc5cdd4d-b5a4-4397-a275-8ac2a0433e57 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:26.202810 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dc5cdd4d-b5a4-4397-a275-8ac2a0433e57 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:26.203489 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dc5cdd4d-b5a4-4397-a275-8ac2a0433e57 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:26.230869 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-dc5cdd4d-b5a4-4397-a275-8ac2a0433e57 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] [instance: 6bc83901-92e8-41d6-836a-bf66159a61fe] Going to try to terminate instance {{(pid=117607) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 12:30:26.290597 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d6d93039-21e2-4fc9-b17a-6269b90936fc tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:26.298067 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d6d93039-21e2-4fc9-b17a-6269b90936fc tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9" status: 200 len: 1367 microversion: 2.1 time: 0.162256 Jun 16 12:30:26.298627 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 264/536] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:26 2022] GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:30:26.308193 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-dc5cdd4d-b5a4-4397-a275-8ac2a0433e57 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] 10.222.0.45 "DELETE /compute/v2.1/servers/6bc83901-92e8-41d6-836a-bf66159a61fe" status: 204 len: 0 microversion: 2.1 time: 0.118073 Jun 16 12:30:26.308803 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 273/537] 10.222.0.45 () {58 vars in 1238 bytes} [Thu Jun 16 12:30:26 2022] DELETE /compute/v2.1/servers/6bc83901-92e8-41d6-836a-bf66159a61fe => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 12:30:26.317501 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9f4280f3-4dc8-4120-b916-5c74b03032f4 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:26.318216 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9f4280f3-4dc8-4120-b916-5c74b03032f4 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] [instance: 6bc83901-92e8-41d6-836a-bf66159a61fe] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:26.325018 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9f4280f3-4dc8-4120-b916-5c74b03032f4 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:26.325488 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9f4280f3-4dc8-4120-b916-5c74b03032f4 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:26.326303 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9f4280f3-4dc8-4120-b916-5c74b03032f4 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:26.326742 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9f4280f3-4dc8-4120-b916-5c74b03032f4 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:26.454833 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9f4280f3-4dc8-4120-b916-5c74b03032f4 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03828f516fce48d7b00b7027f6848190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10da9307eea6448ca287f557b450e3f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:26.462685 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9f4280f3-4dc8-4120-b916-5c74b03032f4 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] 10.222.0.45 "GET /compute/v2.1/servers/6bc83901-92e8-41d6-836a-bf66159a61fe" status: 200 len: 1503 microversion: 2.1 time: 0.149810 Jun 16 12:30:26.463619 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 265/538] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:26 2022] GET /compute/v2.1/servers/6bc83901-92e8-41d6-836a-bf66159a61fe => generated 1503 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:30:26.953157 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-29c687e7-da29-4a5c-827a-ba25096b575a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:26.953856 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-29c687e7-da29-4a5c-827a-ba25096b575a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:26.960503 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-29c687e7-da29-4a5c-827a-ba25096b575a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:26.960960 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-29c687e7-da29-4a5c-827a-ba25096b575a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:26.961764 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-29c687e7-da29-4a5c-827a-ba25096b575a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:26.962225 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-29c687e7-da29-4a5c-827a-ba25096b575a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:27.094529 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-29c687e7-da29-4a5c-827a-ba25096b575a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:27.102741 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-29c687e7-da29-4a5c-827a-ba25096b575a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:27.105339 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-29c687e7-da29-4a5c-827a-ba25096b575a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:27.106577 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-29c687e7-da29-4a5c-827a-ba25096b575a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1750 microversion: 2.20 time: 0.157734 Jun 16 12:30:27.107143 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 274/539] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:30:26 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1750 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:30:27.315400 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-86333fad-0f85-410c-8f6b-dd0b76c5cc07 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:27.315935 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-86333fad-0f85-410c-8f6b-dd0b76c5cc07 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9abc4b09-7cfc-47dc-b778-684eb2e331b9] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:27.322555 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-86333fad-0f85-410c-8f6b-dd0b76c5cc07 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:27.323006 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-86333fad-0f85-410c-8f6b-dd0b76c5cc07 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:27.323763 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-86333fad-0f85-410c-8f6b-dd0b76c5cc07 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:27.324204 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-86333fad-0f85-410c-8f6b-dd0b76c5cc07 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:27.454967 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-86333fad-0f85-410c-8f6b-dd0b76c5cc07 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:27.462658 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-86333fad-0f85-410c-8f6b-dd0b76c5cc07 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9" status: 200 len: 1367 microversion: 2.1 time: 0.151149 Jun 16 12:30:27.463851 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 266/540] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:27 2022] GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:30:27.478837 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b1bcbcbf-a758-4640-88bc-4ee518008049 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:27.479532 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b1bcbcbf-a758-4640-88bc-4ee518008049 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] [instance: 6bc83901-92e8-41d6-836a-bf66159a61fe] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:27.485407 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b1bcbcbf-a758-4640-88bc-4ee518008049 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:27.485881 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b1bcbcbf-a758-4640-88bc-4ee518008049 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:27.486643 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b1bcbcbf-a758-4640-88bc-4ee518008049 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:27.487080 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b1bcbcbf-a758-4640-88bc-4ee518008049 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:27.620171 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b1bcbcbf-a758-4640-88bc-4ee518008049 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03828f516fce48d7b00b7027f6848190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10da9307eea6448ca287f557b450e3f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:27.627983 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b1bcbcbf-a758-4640-88bc-4ee518008049 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] 10.222.0.45 "GET /compute/v2.1/servers/6bc83901-92e8-41d6-836a-bf66159a61fe" status: 200 len: 1503 microversion: 2.1 time: 0.152880 Jun 16 12:30:27.628580 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 275/541] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:27 2022] GET /compute/v2.1/servers/6bc83901-92e8-41d6-836a-bf66159a61fe => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:30:28.125341 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-be180c97-d2ea-4fc2-9e9b-b8f56ae2d188 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:28.125989 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-be180c97-d2ea-4fc2-9e9b-b8f56ae2d188 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:28.132124 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-be180c97-d2ea-4fc2-9e9b-b8f56ae2d188 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:28.132573 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-be180c97-d2ea-4fc2-9e9b-b8f56ae2d188 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:28.133333 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-be180c97-d2ea-4fc2-9e9b-b8f56ae2d188 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:28.133773 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-be180c97-d2ea-4fc2-9e9b-b8f56ae2d188 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:28.261166 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-be180c97-d2ea-4fc2-9e9b-b8f56ae2d188 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:28.269521 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-be180c97-d2ea-4fc2-9e9b-b8f56ae2d188 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:28.271061 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-be180c97-d2ea-4fc2-9e9b-b8f56ae2d188 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:28.272218 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-be180c97-d2ea-4fc2-9e9b-b8f56ae2d188 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1750 microversion: 2.20 time: 0.150795 Jun 16 12:30:28.272778 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 267/542] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:30:28 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1750 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:30:28.480558 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6b507683-f143-4290-83ba-fe9fa5ad8223 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:28.481166 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6b507683-f143-4290-83ba-fe9fa5ad8223 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9abc4b09-7cfc-47dc-b778-684eb2e331b9] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:28.487708 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6b507683-f143-4290-83ba-fe9fa5ad8223 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:28.488157 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6b507683-f143-4290-83ba-fe9fa5ad8223 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:28.488912 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6b507683-f143-4290-83ba-fe9fa5ad8223 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:28.489344 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6b507683-f143-4290-83ba-fe9fa5ad8223 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:28.619625 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6b507683-f143-4290-83ba-fe9fa5ad8223 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:28.626980 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6b507683-f143-4290-83ba-fe9fa5ad8223 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9" status: 200 len: 1367 microversion: 2.1 time: 0.151026 Jun 16 12:30:28.627550 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 276/543] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:28 2022] GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:30:28.644486 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-31abb5b3-929c-4e9c-a14b-e7d57c5e6004 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:28.645094 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-31abb5b3-929c-4e9c-a14b-e7d57c5e6004 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] [instance: 6bc83901-92e8-41d6-836a-bf66159a61fe] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:28.651641 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-31abb5b3-929c-4e9c-a14b-e7d57c5e6004 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:28.652086 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-31abb5b3-929c-4e9c-a14b-e7d57c5e6004 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:28.652832 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-31abb5b3-929c-4e9c-a14b-e7d57c5e6004 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:28.653262 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-31abb5b3-929c-4e9c-a14b-e7d57c5e6004 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:28.788396 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-31abb5b3-929c-4e9c-a14b-e7d57c5e6004 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03828f516fce48d7b00b7027f6848190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10da9307eea6448ca287f557b450e3f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:28.796466 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-31abb5b3-929c-4e9c-a14b-e7d57c5e6004 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] 10.222.0.45 "GET /compute/v2.1/servers/6bc83901-92e8-41d6-836a-bf66159a61fe" status: 200 len: 1503 microversion: 2.1 time: 0.155989 Jun 16 12:30:28.797039 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 268/544] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:28 2022] GET /compute/v2.1/servers/6bc83901-92e8-41d6-836a-bf66159a61fe => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:30:29.289517 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d9a5fc74-c495-4029-b191-7c5033a8ae24 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:29.290168 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d9a5fc74-c495-4029-b191-7c5033a8ae24 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:29.297060 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d9a5fc74-c495-4029-b191-7c5033a8ae24 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:29.297504 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d9a5fc74-c495-4029-b191-7c5033a8ae24 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:29.298281 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d9a5fc74-c495-4029-b191-7c5033a8ae24 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:29.298953 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d9a5fc74-c495-4029-b191-7c5033a8ae24 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:29.435213 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d9a5fc74-c495-4029-b191-7c5033a8ae24 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:29.437514 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:30:29.447945 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d9a5fc74-c495-4029-b191-7c5033a8ae24 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:29.449468 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d9a5fc74-c495-4029-b191-7c5033a8ae24 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:29.450652 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d9a5fc74-c495-4029-b191-7c5033a8ae24 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1750 microversion: 2.20 time: 0.164994 Jun 16 12:30:29.451212 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 277/545] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:30:29 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1750 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:30:29.644307 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3c58c9c0-69ec-4e70-99f9-dd6769979405 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:29.645781 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3c58c9c0-69ec-4e70-99f9-dd6769979405 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9abc4b09-7cfc-47dc-b778-684eb2e331b9] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:29.652658 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3c58c9c0-69ec-4e70-99f9-dd6769979405 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:29.653190 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3c58c9c0-69ec-4e70-99f9-dd6769979405 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:29.653852 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3c58c9c0-69ec-4e70-99f9-dd6769979405 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:29.654629 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3c58c9c0-69ec-4e70-99f9-dd6769979405 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:29.803486 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c9fa2b70-5531-463b-b300-5ad9ab8a6a1b tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:29.804005 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c9fa2b70-5531-463b-b300-5ad9ab8a6a1b tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] [instance: c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:29.811118 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3c58c9c0-69ec-4e70-99f9-dd6769979405 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:29.812263 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c9fa2b70-5531-463b-b300-5ad9ab8a6a1b tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:29.812762 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c9fa2b70-5531-463b-b300-5ad9ab8a6a1b tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:29.814175 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c9fa2b70-5531-463b-b300-5ad9ab8a6a1b tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:29.814882 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c9fa2b70-5531-463b-b300-5ad9ab8a6a1b tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:29.823633 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3c58c9c0-69ec-4e70-99f9-dd6769979405 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9" status: 200 len: 1367 microversion: 2.1 time: 0.183187 Jun 16 12:30:29.826305 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 269/546] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:29 2022] GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9 => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:30:29.831568 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a9085745-bdeb-4e68-90b1-c8363cdee99f tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:29.832178 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a9085745-bdeb-4e68-90b1-c8363cdee99f tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] [instance: 6bc83901-92e8-41d6-836a-bf66159a61fe] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:29.857477 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a9085745-bdeb-4e68-90b1-c8363cdee99f tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:29.859141 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a9085745-bdeb-4e68-90b1-c8363cdee99f tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:29.860542 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a9085745-bdeb-4e68-90b1-c8363cdee99f tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:29.861055 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a9085745-bdeb-4e68-90b1-c8363cdee99f tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:29.978371 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.objects.instance [None req-c9fa2b70-5531-463b-b300-5ad9ab8a6a1b tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lazy-loading 'services' on Instance uuid c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33 {{(pid=117607) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 12:30:30.022410 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a9085745-bdeb-4e68-90b1-c8363cdee99f tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03828f516fce48d7b00b7027f6848190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10da9307eea6448ca287f557b450e3f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:30.030335 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a9085745-bdeb-4e68-90b1-c8363cdee99f tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] 10.222.0.45 "GET /compute/v2.1/servers/6bc83901-92e8-41d6-836a-bf66159a61fe" status: 200 len: 1503 microversion: 2.1 time: 0.203016 Jun 16 12:30:30.040041 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 270/547] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:29 2022] GET /compute/v2.1/servers/6bc83901-92e8-41d6-836a-bf66159a61fe => generated 1503 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:30:30.121294 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c9fa2b70-5531-463b-b300-5ad9ab8a6a1b tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] 10.222.0.45 "DELETE /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33/os-volume_attachments/f409a6f5-a8da-42be-88e9-e632530a0a9d" status: 202 len: 0 microversion: 2.1 time: 0.321432 Jun 16 12:30:30.122108 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 278/548] 10.222.0.45 () {58 vars in 1415 bytes} [Thu Jun 16 12:30:29 2022] DELETE /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33/os-volume_attachments/f409a6f5-a8da-42be-88e9-e632530a0a9d => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 12:30:30.468831 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-75bc1c54-8d03-4ee8-b71f-8c842742c717 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:30.470247 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-75bc1c54-8d03-4ee8-b71f-8c842742c717 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:30.480801 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-75bc1c54-8d03-4ee8-b71f-8c842742c717 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:30.481255 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-75bc1c54-8d03-4ee8-b71f-8c842742c717 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:30.482075 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-75bc1c54-8d03-4ee8-b71f-8c842742c717 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:30.482802 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-75bc1c54-8d03-4ee8-b71f-8c842742c717 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:30.627883 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-75bc1c54-8d03-4ee8-b71f-8c842742c717 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:30.636879 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-75bc1c54-8d03-4ee8-b71f-8c842742c717 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:30.638417 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-75bc1c54-8d03-4ee8-b71f-8c842742c717 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:30.640404 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-75bc1c54-8d03-4ee8-b71f-8c842742c717 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1750 microversion: 2.20 time: 0.175616 Jun 16 12:30:30.640959 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 271/549] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:30:30 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1750 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:30:30.842248 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-16c69c44-55ca-446a-a968-9d521658cc11 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:30.842952 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-16c69c44-55ca-446a-a968-9d521658cc11 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9abc4b09-7cfc-47dc-b778-684eb2e331b9] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:30.849215 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-16c69c44-55ca-446a-a968-9d521658cc11 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:30.849671 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-16c69c44-55ca-446a-a968-9d521658cc11 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:30.850464 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-16c69c44-55ca-446a-a968-9d521658cc11 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:30.850906 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-16c69c44-55ca-446a-a968-9d521658cc11 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:30.987340 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-16c69c44-55ca-446a-a968-9d521658cc11 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:30.995044 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-16c69c44-55ca-446a-a968-9d521658cc11 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9" status: 200 len: 1367 microversion: 2.1 time: 0.158195 Jun 16 12:30:30.995621 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 279/550] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:30 2022] GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:30:31.048002 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c6446437-bc95-4977-a546-cf32f5b5c764 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:31.048710 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c6446437-bc95-4977-a546-cf32f5b5c764 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] [instance: 6bc83901-92e8-41d6-836a-bf66159a61fe] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:31.055365 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c6446437-bc95-4977-a546-cf32f5b5c764 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:31.055813 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c6446437-bc95-4977-a546-cf32f5b5c764 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:31.056905 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c6446437-bc95-4977-a546-cf32f5b5c764 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:31.057347 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c6446437-bc95-4977-a546-cf32f5b5c764 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:31.195818 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c6446437-bc95-4977-a546-cf32f5b5c764 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03828f516fce48d7b00b7027f6848190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10da9307eea6448ca287f557b450e3f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:31.205170 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c6446437-bc95-4977-a546-cf32f5b5c764 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] 10.222.0.45 "GET /compute/v2.1/servers/6bc83901-92e8-41d6-836a-bf66159a61fe" status: 200 len: 1503 microversion: 2.1 time: 0.160913 Jun 16 12:30:31.206015 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 272/551] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:31 2022] GET /compute/v2.1/servers/6bc83901-92e8-41d6-836a-bf66159a61fe => generated 1503 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:30:31.658834 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0e2577cd-0a77-4cc5-95d4-652871b5cf31 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:31.659446 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0e2577cd-0a77-4cc5-95d4-652871b5cf31 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:31.665425 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0e2577cd-0a77-4cc5-95d4-652871b5cf31 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:31.666647 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0e2577cd-0a77-4cc5-95d4-652871b5cf31 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:31.667425 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0e2577cd-0a77-4cc5-95d4-652871b5cf31 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:31.667864 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0e2577cd-0a77-4cc5-95d4-652871b5cf31 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:31.800874 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0e2577cd-0a77-4cc5-95d4-652871b5cf31 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:31.809210 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0e2577cd-0a77-4cc5-95d4-652871b5cf31 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:31.810833 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0e2577cd-0a77-4cc5-95d4-652871b5cf31 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:31.811973 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0e2577cd-0a77-4cc5-95d4-652871b5cf31 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1750 microversion: 2.20 time: 0.157263 Jun 16 12:30:31.812541 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 280/552] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:30:31 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1750 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 12:30:32.013005 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9105ba32-26dd-46e1-9c9b-c99e8027b03f tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:32.014033 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9105ba32-26dd-46e1-9c9b-c99e8027b03f tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9abc4b09-7cfc-47dc-b778-684eb2e331b9] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:32.021390 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9105ba32-26dd-46e1-9c9b-c99e8027b03f tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:32.021851 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9105ba32-26dd-46e1-9c9b-c99e8027b03f tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:32.022650 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9105ba32-26dd-46e1-9c9b-c99e8027b03f tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:32.023090 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9105ba32-26dd-46e1-9c9b-c99e8027b03f tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:32.169638 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9105ba32-26dd-46e1-9c9b-c99e8027b03f tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:32.177704 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9105ba32-26dd-46e1-9c9b-c99e8027b03f tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9" status: 200 len: 1367 microversion: 2.1 time: 0.169819 Jun 16 12:30:32.178426 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 273/553] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:32 2022] GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:30:32.223335 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1bb7f665-30be-480a-a73f-f9d099cfd641 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:32.224038 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1bb7f665-30be-480a-a73f-f9d099cfd641 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] [instance: 6bc83901-92e8-41d6-836a-bf66159a61fe] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:32.233952 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1bb7f665-30be-480a-a73f-f9d099cfd641 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:32.234327 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-436efe6b-47e9-4daf-9232-108465f7e5ff req-3acde3d1-2aef-47cc-b797-e17ec4a37fd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9abc4b09-7cfc-47dc-b778-684eb2e331b9", "name": "network-vif-plugged", "status": "completed", "tag": "00492cc8-699c-4660-9bfd-0cd1a05f4e44"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:30:32.234988 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1bb7f665-30be-480a-a73f-f9d099cfd641 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:32.236245 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1bb7f665-30be-480a-a73f-f9d099cfd641 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:32.236897 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1bb7f665-30be-480a-a73f-f9d099cfd641 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:32.244748 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-436efe6b-47e9-4daf-9232-108465f7e5ff req-3acde3d1-2aef-47cc-b797-e17ec4a37fd9 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:32.245694 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-436efe6b-47e9-4daf-9232-108465f7e5ff req-3acde3d1-2aef-47cc-b797-e17ec4a37fd9 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:32.257462 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-436efe6b-47e9-4daf-9232-108465f7e5ff req-3acde3d1-2aef-47cc-b797-e17ec4a37fd9 service nova] Creating event network-vif-plugged:00492cc8-699c-4660-9bfd-0cd1a05f4e44 for instance 9abc4b09-7cfc-47dc-b778-684eb2e331b9 on hv-cinder-84614 Jun 16 12:30:32.262426 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-436efe6b-47e9-4daf-9232-108465f7e5ff req-3acde3d1-2aef-47cc-b797-e17ec4a37fd9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033007 Jun 16 12:30:32.263551 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 274/554] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:30:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:30:32.416235 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1bb7f665-30be-480a-a73f-f9d099cfd641 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03828f516fce48d7b00b7027f6848190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10da9307eea6448ca287f557b450e3f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:32.424880 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1bb7f665-30be-480a-a73f-f9d099cfd641 tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] 10.222.0.45 "GET /compute/v2.1/servers/6bc83901-92e8-41d6-836a-bf66159a61fe" status: 200 len: 1503 microversion: 2.1 time: 0.205467 Jun 16 12:30:32.429747 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 281/555] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:32 2022] GET /compute/v2.1/servers/6bc83901-92e8-41d6-836a-bf66159a61fe => generated 1503 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:30:32.488210 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-087846d1-914f-4954-8315-eca41cff6458 req-1d307a0e-df48-4b3b-9872-b540091608f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bc83901-92e8-41d6-836a-bf66159a61fe", "name": "network-vif-deleted", "tag": "c2d25ec4-314d-4236-8c08-702eec94ea43"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:30:32.504848 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-087846d1-914f-4954-8315-eca41cff6458 req-1d307a0e-df48-4b3b-9872-b540091608f5 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:32.505297 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-087846d1-914f-4954-8315-eca41cff6458 req-1d307a0e-df48-4b3b-9872-b540091608f5 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:32.520528 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-087846d1-914f-4954-8315-eca41cff6458 req-1d307a0e-df48-4b3b-9872-b540091608f5 service nova] Creating event network-vif-deleted:c2d25ec4-314d-4236-8c08-702eec94ea43 for instance 6bc83901-92e8-41d6-836a-bf66159a61fe on hv-cinder-84614 Jun 16 12:30:32.525898 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-087846d1-914f-4954-8315-eca41cff6458 req-1d307a0e-df48-4b3b-9872-b540091608f5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041066 Jun 16 12:30:32.526846 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 275/556] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:30:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:30:32.830243 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-be76e4e1-4797-43ee-b047-f6ddeaac379a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:32.831553 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-be76e4e1-4797-43ee-b047-f6ddeaac379a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:32.839655 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-be76e4e1-4797-43ee-b047-f6ddeaac379a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:32.840235 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-be76e4e1-4797-43ee-b047-f6ddeaac379a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:32.841129 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-be76e4e1-4797-43ee-b047-f6ddeaac379a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:32.841662 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-be76e4e1-4797-43ee-b047-f6ddeaac379a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:33.043246 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-be76e4e1-4797-43ee-b047-f6ddeaac379a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:33.051660 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-be76e4e1-4797-43ee-b047-f6ddeaac379a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:33.053155 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-be76e4e1-4797-43ee-b047-f6ddeaac379a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:33.054374 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-be76e4e1-4797-43ee-b047-f6ddeaac379a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1806 microversion: 2.20 time: 0.228010 Jun 16 12:30:33.054928 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 282/557] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:30:32 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1806 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:30:33.196475 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8f2cf8f0-be23-499d-9caf-dfd7f8218995 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:33.198024 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8f2cf8f0-be23-499d-9caf-dfd7f8218995 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9abc4b09-7cfc-47dc-b778-684eb2e331b9] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:33.205195 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8f2cf8f0-be23-499d-9caf-dfd7f8218995 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:33.205671 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8f2cf8f0-be23-499d-9caf-dfd7f8218995 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:33.206623 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8f2cf8f0-be23-499d-9caf-dfd7f8218995 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:33.207093 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8f2cf8f0-be23-499d-9caf-dfd7f8218995 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:33.335001 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8f2cf8f0-be23-499d-9caf-dfd7f8218995 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:33.343127 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8f2cf8f0-be23-499d-9caf-dfd7f8218995 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9" status: 200 len: 1367 microversion: 2.1 time: 0.151391 Jun 16 12:30:33.343994 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 276/558] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:33 2022] GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:30:33.370447 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b4e6366a-e3b8-4ee9-bba9-b396e7d30b20 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:33.370971 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b4e6366a-e3b8-4ee9-bba9-b396e7d30b20 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] [instance: c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:33.377470 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b4e6366a-e3b8-4ee9-bba9-b396e7d30b20 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:33.377953 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b4e6366a-e3b8-4ee9-bba9-b396e7d30b20 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:33.378754 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b4e6366a-e3b8-4ee9-bba9-b396e7d30b20 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:33.379194 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b4e6366a-e3b8-4ee9-bba9-b396e7d30b20 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:33.406186 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b4e6366a-e3b8-4ee9-bba9-b396e7d30b20 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] [instance: c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33] Going to try to terminate instance {{(pid=117607) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 12:30:33.443476 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-71e3d51f-bd64-4d10-a577-700f9c44de0f tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:33.444308 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-71e3d51f-bd64-4d10-a577-700f9c44de0f tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] [instance: 6bc83901-92e8-41d6-836a-bf66159a61fe] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:33.452075 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-71e3d51f-bd64-4d10-a577-700f9c44de0f tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:33.452456 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-71e3d51f-bd64-4d10-a577-700f9c44de0f tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:33.453449 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-71e3d51f-bd64-4d10-a577-700f9c44de0f tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:33.454015 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-71e3d51f-bd64-4d10-a577-700f9c44de0f tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:33.468252 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-71e3d51f-bd64-4d10-a577-700f9c44de0f tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] HTTP exception thrown: Instance 6bc83901-92e8-41d6-836a-bf66159a61fe could not be found. Jun 16 12:30:33.470865 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-71e3d51f-bd64-4d10-a577-700f9c44de0f tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Request method failure captured: Jun 16 12:30:33.470865 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: request: GET /compute/v2.1/servers/6bc83901-92e8-41d6-836a-bf66159a61fe HTTP/1.1 Jun 16 12:30:33.470865 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 16 12:30:33.470865 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 16 12:30:33.470865 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Connection: close Jun 16 12:30:33.470865 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 16 12:30:33.470865 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 16 12:30:33.470865 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Host: 10.222.0.45 Jun 16 12:30:33.470865 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 16 12:30:33.470865 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 16 12:30:33.470865 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABiqyIoAnXrIQ58vSvXSKUkjUtCA6cM2kwP3euQOOxcQS9mHn4cnMY6tW-vQm5FV6ZxbtkKeoMGeoyLFpugxdm56idIJPJN7NaYJlBDG_d1opT6TR7iK2NIX6yMwuh44srpQH4Wu8W7UznG-jeP9ZmR-fEptHFWiOofQqU4ljswMqboCJk Jun 16 12:30:33.470865 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 16 12:30:33.470865 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 16 12:30:33.470865 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 16 12:30:33.470865 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 16 12:30:33.470865 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 16 12:30:33.470865 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 16 12:30:33.470865 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Id: 10da9307eea6448ca287f557b450e3f4 Jun 16 12:30:33.470865 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-VolumesActionsTest-101617276 Jun 16 12:30:33.470865 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 16 12:30:33.470865 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 16 12:30:33.473096 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/10da9307eea6448ca287f557b450e3f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/10da9307eea6448ca287f557b450e3f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_10da9307eea6448ca287f557b450e3f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/10da9307eea6448ca287f557b450e3f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Jun 16 12:30:33.473096 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-VolumesActionsTest-101617276 Jun 16 12:30:33.473096 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 10da9307eea6448ca287f557b450e3f4 Jun 16 12:30:33.473096 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-VolumesActionsTest-101617276 Jun 16 12:30:33.473096 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User: tempest-VolumesActionsTest-101617276-project Jun 16 12:30:33.473096 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 16 12:30:33.473096 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 16 12:30:33.473096 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Id: 03828f516fce48d7b00b7027f6848190 Jun 16 12:30:33.473096 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-VolumesActionsTest-101617276-project Jun 16 12:30:33.473096 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: method: > Jun 16 12:30:33.473096 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: exception: Instance 6bc83901-92e8-41d6-836a-bf66159a61fe could not be found. Jun 16 12:30:33.473096 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: action_args: {'id': '6bc83901-92e8-41d6-836a-bf66159a61fe'} Jun 16 12:30:33.474358 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:30:33.474358 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:30:33.474358 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:30:33.474358 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:30:33.474358 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:30:33.474358 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:30:33.474358 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:30:33.474358 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:30:33.474358 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:30:33.474358 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:30:33.474358 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bc83901-92e8-41d6-836a-bf66159a61fe could not be found. Jun 16 12:30:33.474358 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:30:33.474358 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:30:33.474358 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:30:33.474358 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:30:33.474358 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:30:33.474358 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:30:33.474358 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:30:33.474358 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:30:33.474358 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:30:33.475820 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:30:33.475820 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 12:30:33.475820 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 12:30:33.475820 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:30:33.475820 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:30:33.475820 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:30:33.475820 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:30:33.475820 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bc83901-92e8-41d6-836a-bf66159a61fe could not be found. Jun 16 12:30:33.475820 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:30:33.475820 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:30:33.475820 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:30:33.475820 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:30:33.475820 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:30:33.475820 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:30:33.475820 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:30:33.475820 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:30:33.475820 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bc83901-92e8-41d6-836a-bf66159a61fe could not be found. Jun 16 12:30:33.475820 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:30:33.477145 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-71e3d51f-bd64-4d10-a577-700f9c44de0f tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] Returning 404 to user: Instance 6bc83901-92e8-41d6-836a-bf66159a61fe could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:30:33.477145 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-71e3d51f-bd64-4d10-a577-700f9c44de0f tempest-VolumesActionsTest-101617276 tempest-VolumesActionsTest-101617276-project] 10.222.0.45 "GET /compute/v2.1/servers/6bc83901-92e8-41d6-836a-bf66159a61fe" status: 404 len: 111 microversion: 2.1 time: 0.033988 Jun 16 12:30:33.477145 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 277/559] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:33 2022] GET /compute/v2.1/servers/6bc83901-92e8-41d6-836a-bf66159a61fe => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 12:30:33.498756 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b4e6366a-e3b8-4ee9-bba9-b396e7d30b20 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] 10.222.0.45 "DELETE /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33" status: 204 len: 0 microversion: 2.1 time: 0.132213 Jun 16 12:30:33.499332 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 283/560] 10.222.0.45 () {58 vars in 1238 bytes} [Thu Jun 16 12:30:33 2022] DELETE /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 12:30:33.507587 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f91c3c43-4ca2-4d9d-a348-eee0a7d2c179 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:33.508283 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f91c3c43-4ca2-4d9d-a348-eee0a7d2c179 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] [instance: c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:33.516102 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f91c3c43-4ca2-4d9d-a348-eee0a7d2c179 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:33.516913 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f91c3c43-4ca2-4d9d-a348-eee0a7d2c179 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:33.521108 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f91c3c43-4ca2-4d9d-a348-eee0a7d2c179 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:33.521108 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f91c3c43-4ca2-4d9d-a348-eee0a7d2c179 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:33.653541 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f91c3c43-4ca2-4d9d-a348-eee0a7d2c179 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f451e0f5c945d8ade3c2a4ea3398c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09e491f80c24a2691e396df0175a057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:33.661336 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f91c3c43-4ca2-4d9d-a348-eee0a7d2c179 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] 10.222.0.45 "GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33" status: 200 len: 1513 microversion: 2.1 time: 0.157781 Jun 16 12:30:33.661917 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 278/561] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:33 2022] GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:30:34.076207 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d7d0c3be-ab95-44f7-a3be-4ff3cd09213b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:34.077632 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d7d0c3be-ab95-44f7-a3be-4ff3cd09213b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:34.087670 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d7d0c3be-ab95-44f7-a3be-4ff3cd09213b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:34.088485 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d7d0c3be-ab95-44f7-a3be-4ff3cd09213b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:34.090248 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d7d0c3be-ab95-44f7-a3be-4ff3cd09213b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:34.091032 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d7d0c3be-ab95-44f7-a3be-4ff3cd09213b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:34.231968 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d7d0c3be-ab95-44f7-a3be-4ff3cd09213b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:34.240410 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d7d0c3be-ab95-44f7-a3be-4ff3cd09213b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:34.241959 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d7d0c3be-ab95-44f7-a3be-4ff3cd09213b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:34.243110 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d7d0c3be-ab95-44f7-a3be-4ff3cd09213b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1806 microversion: 2.20 time: 0.174127 Jun 16 12:30:34.243669 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 284/562] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:30:34 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1806 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:30:34.360732 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c9ecdc5b-92e7-4f90-bf7c-0bed7a02995c tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:34.361373 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c9ecdc5b-92e7-4f90-bf7c-0bed7a02995c tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9abc4b09-7cfc-47dc-b778-684eb2e331b9] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:34.367880 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c9ecdc5b-92e7-4f90-bf7c-0bed7a02995c tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:34.368322 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c9ecdc5b-92e7-4f90-bf7c-0bed7a02995c tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:34.369686 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c9ecdc5b-92e7-4f90-bf7c-0bed7a02995c tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:34.370165 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c9ecdc5b-92e7-4f90-bf7c-0bed7a02995c tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:34.497085 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c9ecdc5b-92e7-4f90-bf7c-0bed7a02995c tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:34.504506 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c9ecdc5b-92e7-4f90-bf7c-0bed7a02995c tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9" status: 200 len: 1367 microversion: 2.1 time: 0.147785 Jun 16 12:30:34.505064 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 279/563] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:34 2022] GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:30:34.678394 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3182a516-67a9-4809-8049-d2b2990b3e0e tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:34.679029 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3182a516-67a9-4809-8049-d2b2990b3e0e tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] [instance: c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:34.685476 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3182a516-67a9-4809-8049-d2b2990b3e0e tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:34.685959 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3182a516-67a9-4809-8049-d2b2990b3e0e tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:34.686721 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3182a516-67a9-4809-8049-d2b2990b3e0e tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:34.687167 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3182a516-67a9-4809-8049-d2b2990b3e0e tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:34.814398 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-3182a516-67a9-4809-8049-d2b2990b3e0e tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f451e0f5c945d8ade3c2a4ea3398c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09e491f80c24a2691e396df0175a057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:34.821712 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3182a516-67a9-4809-8049-d2b2990b3e0e tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] 10.222.0.45 "GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33" status: 200 len: 1513 microversion: 2.1 time: 0.147143 Jun 16 12:30:34.822532 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 285/564] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:34 2022] GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33 => generated 1513 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:30:35.260867 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f2323b02-f5a7-4c6f-b811-7c400e7b2067 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:35.261530 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f2323b02-f5a7-4c6f-b811-7c400e7b2067 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:35.267642 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f2323b02-f5a7-4c6f-b811-7c400e7b2067 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:35.268083 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f2323b02-f5a7-4c6f-b811-7c400e7b2067 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:35.268835 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f2323b02-f5a7-4c6f-b811-7c400e7b2067 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:35.269268 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f2323b02-f5a7-4c6f-b811-7c400e7b2067 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:35.402239 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f2323b02-f5a7-4c6f-b811-7c400e7b2067 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:35.412428 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f2323b02-f5a7-4c6f-b811-7c400e7b2067 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:35.414269 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f2323b02-f5a7-4c6f-b811-7c400e7b2067 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:35.416285 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f2323b02-f5a7-4c6f-b811-7c400e7b2067 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1806 microversion: 2.20 time: 0.158584 Jun 16 12:30:35.421442 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 280/565] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:30:35 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1806 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:30:35.520646 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-45b6e856-530e-4baf-aa61-05d894f638f9 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:35.521161 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-45b6e856-530e-4baf-aa61-05d894f638f9 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9abc4b09-7cfc-47dc-b778-684eb2e331b9] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:35.527785 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-45b6e856-530e-4baf-aa61-05d894f638f9 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:35.528233 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-45b6e856-530e-4baf-aa61-05d894f638f9 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:35.528993 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-45b6e856-530e-4baf-aa61-05d894f638f9 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:35.529429 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-45b6e856-530e-4baf-aa61-05d894f638f9 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:35.655435 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-45b6e856-530e-4baf-aa61-05d894f638f9 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:35.663077 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-45b6e856-530e-4baf-aa61-05d894f638f9 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9" status: 200 len: 1367 microversion: 2.1 time: 0.146353 Jun 16 12:30:35.663647 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 286/566] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:35 2022] GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:30:35.839465 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b485bd9e-3eb7-4910-8bfd-8cc4006314c8 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:35.840006 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b485bd9e-3eb7-4910-8bfd-8cc4006314c8 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] [instance: c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:35.846157 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b485bd9e-3eb7-4910-8bfd-8cc4006314c8 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:35.846608 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b485bd9e-3eb7-4910-8bfd-8cc4006314c8 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:35.847366 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b485bd9e-3eb7-4910-8bfd-8cc4006314c8 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:35.847802 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b485bd9e-3eb7-4910-8bfd-8cc4006314c8 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:35.986670 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b485bd9e-3eb7-4910-8bfd-8cc4006314c8 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f451e0f5c945d8ade3c2a4ea3398c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09e491f80c24a2691e396df0175a057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:35.994123 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b485bd9e-3eb7-4910-8bfd-8cc4006314c8 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] 10.222.0.45 "GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33" status: 200 len: 1513 microversion: 2.1 time: 0.159203 Jun 16 12:30:35.994684 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 281/567] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:35 2022] GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33 => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:30:36.437648 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6176e52b-a9f6-48ec-95c3-05eb791c9adc tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:36.438269 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6176e52b-a9f6-48ec-95c3-05eb791c9adc tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:36.440804 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:30:36.449189 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6176e52b-a9f6-48ec-95c3-05eb791c9adc tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:36.450046 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6176e52b-a9f6-48ec-95c3-05eb791c9adc tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:36.451087 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6176e52b-a9f6-48ec-95c3-05eb791c9adc tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:36.451530 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6176e52b-a9f6-48ec-95c3-05eb791c9adc tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:36.598316 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6176e52b-a9f6-48ec-95c3-05eb791c9adc tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:36.607616 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6176e52b-a9f6-48ec-95c3-05eb791c9adc tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:36.609131 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6176e52b-a9f6-48ec-95c3-05eb791c9adc tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:36.610323 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6176e52b-a9f6-48ec-95c3-05eb791c9adc tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1806 microversion: 2.20 time: 0.177027 Jun 16 12:30:36.610881 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 287/568] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:30:36 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1806 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 12:30:36.681863 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-63688fc2-75da-4016-bdd4-2bd1ed6ac1db tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:36.682747 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-63688fc2-75da-4016-bdd4-2bd1ed6ac1db tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9abc4b09-7cfc-47dc-b778-684eb2e331b9] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:36.689611 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-63688fc2-75da-4016-bdd4-2bd1ed6ac1db tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:36.690087 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-63688fc2-75da-4016-bdd4-2bd1ed6ac1db tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:36.690850 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-63688fc2-75da-4016-bdd4-2bd1ed6ac1db tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:36.691289 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-63688fc2-75da-4016-bdd4-2bd1ed6ac1db tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:36.830134 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-63688fc2-75da-4016-bdd4-2bd1ed6ac1db tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:36.838102 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-63688fc2-75da-4016-bdd4-2bd1ed6ac1db tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9" status: 200 len: 1367 microversion: 2.1 time: 0.160298 Jun 16 12:30:36.838809 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 282/569] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:36 2022] GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:30:37.011330 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d8725b17-87ea-4c17-b9a7-2ef6f5ca89e1 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:37.011935 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d8725b17-87ea-4c17-b9a7-2ef6f5ca89e1 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] [instance: c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:37.017931 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d8725b17-87ea-4c17-b9a7-2ef6f5ca89e1 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:37.018377 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d8725b17-87ea-4c17-b9a7-2ef6f5ca89e1 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:37.019135 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d8725b17-87ea-4c17-b9a7-2ef6f5ca89e1 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:37.019542 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d8725b17-87ea-4c17-b9a7-2ef6f5ca89e1 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:37.158456 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d8725b17-87ea-4c17-b9a7-2ef6f5ca89e1 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f451e0f5c945d8ade3c2a4ea3398c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09e491f80c24a2691e396df0175a057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:37.166604 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d8725b17-87ea-4c17-b9a7-2ef6f5ca89e1 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] 10.222.0.45 "GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33" status: 200 len: 1513 microversion: 2.1 time: 0.158736 Jun 16 12:30:37.167189 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 288/570] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:37 2022] GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33 => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:30:37.630479 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3621441b-2477-481b-a37e-66433a8b22b4 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:37.630958 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3621441b-2477-481b-a37e-66433a8b22b4 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:37.638106 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3621441b-2477-481b-a37e-66433a8b22b4 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:37.638553 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3621441b-2477-481b-a37e-66433a8b22b4 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:37.639305 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3621441b-2477-481b-a37e-66433a8b22b4 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:37.639740 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3621441b-2477-481b-a37e-66433a8b22b4 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:37.643765 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:30:37.769449 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3621441b-2477-481b-a37e-66433a8b22b4 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:37.778239 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3621441b-2477-481b-a37e-66433a8b22b4 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:37.779742 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3621441b-2477-481b-a37e-66433a8b22b4 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:37.780883 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3621441b-2477-481b-a37e-66433a8b22b4 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1806 microversion: 2.20 time: 0.154381 Jun 16 12:30:37.781439 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 283/571] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:30:37 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1806 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:30:37.854520 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-cd01ec1f-39a5-4bcb-9195-a1c1fe495e35 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:37.855132 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-cd01ec1f-39a5-4bcb-9195-a1c1fe495e35 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9abc4b09-7cfc-47dc-b778-684eb2e331b9] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:37.861257 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cd01ec1f-39a5-4bcb-9195-a1c1fe495e35 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:37.861707 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cd01ec1f-39a5-4bcb-9195-a1c1fe495e35 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:37.862519 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cd01ec1f-39a5-4bcb-9195-a1c1fe495e35 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:37.862959 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cd01ec1f-39a5-4bcb-9195-a1c1fe495e35 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:37.992496 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-cd01ec1f-39a5-4bcb-9195-a1c1fe495e35 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:38.000534 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-cd01ec1f-39a5-4bcb-9195-a1c1fe495e35 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9" status: 200 len: 1367 microversion: 2.1 time: 0.149820 Jun 16 12:30:38.001093 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 289/572] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:37 2022] GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:30:38.183185 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-bf54e37b-641a-4acc-b636-0abefb1c9f9e tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:38.183791 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-bf54e37b-641a-4acc-b636-0abefb1c9f9e tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] [instance: c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:38.190167 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bf54e37b-641a-4acc-b636-0abefb1c9f9e tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:38.190612 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bf54e37b-641a-4acc-b636-0abefb1c9f9e tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:38.191428 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bf54e37b-641a-4acc-b636-0abefb1c9f9e tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:38.191814 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bf54e37b-641a-4acc-b636-0abefb1c9f9e tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:38.320131 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-bf54e37b-641a-4acc-b636-0abefb1c9f9e tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f451e0f5c945d8ade3c2a4ea3398c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09e491f80c24a2691e396df0175a057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:38.327786 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-bf54e37b-641a-4acc-b636-0abefb1c9f9e tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] 10.222.0.45 "GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33" status: 200 len: 1513 microversion: 2.1 time: 0.149081 Jun 16 12:30:38.328362 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 284/573] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:38 2022] GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33 => generated 1513 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:30:38.803525 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-9bd44c75-03d7-4789-a6d8-fec0081ec064 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:38.804113 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-9bd44c75-03d7-4789-a6d8-fec0081ec064 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:38.810287 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9bd44c75-03d7-4789-a6d8-fec0081ec064 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:38.810737 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9bd44c75-03d7-4789-a6d8-fec0081ec064 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:38.811495 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9bd44c75-03d7-4789-a6d8-fec0081ec064 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:38.811930 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9bd44c75-03d7-4789-a6d8-fec0081ec064 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:38.944113 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-9bd44c75-03d7-4789-a6d8-fec0081ec064 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:38.953200 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-9bd44c75-03d7-4789-a6d8-fec0081ec064 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:38.954744 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-9bd44c75-03d7-4789-a6d8-fec0081ec064 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:38.955896 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-9bd44c75-03d7-4789-a6d8-fec0081ec064 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1806 microversion: 2.20 time: 0.156413 Jun 16 12:30:38.956453 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 290/574] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:30:38 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1806 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:30:39.016557 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f68a16d0-5c65-4b26-8a4c-d46992852df4 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:39.017172 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f68a16d0-5c65-4b26-8a4c-d46992852df4 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9abc4b09-7cfc-47dc-b778-684eb2e331b9] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:39.023679 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f68a16d0-5c65-4b26-8a4c-d46992852df4 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:39.024116 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f68a16d0-5c65-4b26-8a4c-d46992852df4 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:39.025508 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f68a16d0-5c65-4b26-8a4c-d46992852df4 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:39.026002 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f68a16d0-5c65-4b26-8a4c-d46992852df4 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:39.170583 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f68a16d0-5c65-4b26-8a4c-d46992852df4 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:39.178998 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f68a16d0-5c65-4b26-8a4c-d46992852df4 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9" status: 200 len: 1367 microversion: 2.1 time: 0.166231 Jun 16 12:30:39.179687 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 285/575] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:39 2022] GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:30:39.344396 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8041b206-9385-4aad-86ac-9b7566dff896 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:39.345008 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8041b206-9385-4aad-86ac-9b7566dff896 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] [instance: c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:39.350993 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8041b206-9385-4aad-86ac-9b7566dff896 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:39.351441 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8041b206-9385-4aad-86ac-9b7566dff896 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:39.352197 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8041b206-9385-4aad-86ac-9b7566dff896 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:39.352631 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8041b206-9385-4aad-86ac-9b7566dff896 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:39.483998 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8041b206-9385-4aad-86ac-9b7566dff896 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f451e0f5c945d8ade3c2a4ea3398c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09e491f80c24a2691e396df0175a057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:39.491935 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8041b206-9385-4aad-86ac-9b7566dff896 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] 10.222.0.45 "GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33" status: 200 len: 1513 microversion: 2.1 time: 0.151374 Jun 16 12:30:39.492500 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 291/576] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:39 2022] GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:30:39.975127 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e860a9e3-7395-4342-a08b-766bec07b776 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:39.975919 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e860a9e3-7395-4342-a08b-766bec07b776 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:39.982582 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e860a9e3-7395-4342-a08b-766bec07b776 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:39.983048 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e860a9e3-7395-4342-a08b-766bec07b776 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:39.983777 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e860a9e3-7395-4342-a08b-766bec07b776 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:39.984205 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e860a9e3-7395-4342-a08b-766bec07b776 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:40.113845 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e860a9e3-7395-4342-a08b-766bec07b776 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:40.122324 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e860a9e3-7395-4342-a08b-766bec07b776 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:40.123916 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e860a9e3-7395-4342-a08b-766bec07b776 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:40.125170 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e860a9e3-7395-4342-a08b-766bec07b776 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1806 microversion: 2.20 time: 0.154128 Jun 16 12:30:40.125744 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 286/577] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:30:39 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1806 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:30:40.200499 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0e8e41fc-cd8c-4937-b5ef-f7c185b94d99 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:40.201734 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0e8e41fc-cd8c-4937-b5ef-f7c185b94d99 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9abc4b09-7cfc-47dc-b778-684eb2e331b9] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:40.216951 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0e8e41fc-cd8c-4937-b5ef-f7c185b94d99 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:40.217810 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0e8e41fc-cd8c-4937-b5ef-f7c185b94d99 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:40.218861 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0e8e41fc-cd8c-4937-b5ef-f7c185b94d99 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:40.219736 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0e8e41fc-cd8c-4937-b5ef-f7c185b94d99 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:40.224437 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:30:40.508326 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2207a54c-0f2e-4278-bbe8-c16308b9c48c tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:40.509772 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2207a54c-0f2e-4278-bbe8-c16308b9c48c tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] [instance: c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:40.523907 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2207a54c-0f2e-4278-bbe8-c16308b9c48c tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:40.524285 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2207a54c-0f2e-4278-bbe8-c16308b9c48c tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:40.526359 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2207a54c-0f2e-4278-bbe8-c16308b9c48c tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:40.526807 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2207a54c-0f2e-4278-bbe8-c16308b9c48c tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:40.741454 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0e8e41fc-cd8c-4937-b5ef-f7c185b94d99 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:40.750479 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0e8e41fc-cd8c-4937-b5ef-f7c185b94d99 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9" status: 200 len: 1557 microversion: 2.1 time: 0.557919 Jun 16 12:30:40.755310 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 292/578] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:40 2022] GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9 => generated 1557 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:30:40.770074 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-30583d50-fa44-416f-95d3-1b4d92c6d43b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:40.776323 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-30583d50-fa44-416f-95d3-1b4d92c6d43b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9abc4b09-7cfc-47dc-b778-684eb2e331b9] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:40.786265 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-30583d50-fa44-416f-95d3-1b4d92c6d43b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:40.786715 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-30583d50-fa44-416f-95d3-1b4d92c6d43b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:40.787523 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-30583d50-fa44-416f-95d3-1b4d92c6d43b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:40.787958 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-30583d50-fa44-416f-95d3-1b4d92c6d43b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:40.846380 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2207a54c-0f2e-4278-bbe8-c16308b9c48c tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f451e0f5c945d8ade3c2a4ea3398c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09e491f80c24a2691e396df0175a057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:40.856114 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2207a54c-0f2e-4278-bbe8-c16308b9c48c tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] 10.222.0.45 "GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33" status: 200 len: 1513 microversion: 2.1 time: 0.351448 Jun 16 12:30:40.858521 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 287/579] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:40 2022] GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33 => generated 1513 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:30:40.930286 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-30583d50-fa44-416f-95d3-1b4d92c6d43b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.167257 Jun 16 12:30:40.931035 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 293/580] 10.222.0.45 () {58 vars in 1274 bytes} [Thu Jun 16 12:30:40 2022] GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9/os-interface => generated 284 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 12:30:41.145247 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-27843286-f216-4fb9-a6f2-16f4ed653196 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:41.146116 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-27843286-f216-4fb9-a6f2-16f4ed653196 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:41.161173 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-27843286-f216-4fb9-a6f2-16f4ed653196 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:41.161999 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-27843286-f216-4fb9-a6f2-16f4ed653196 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:41.166343 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-27843286-f216-4fb9-a6f2-16f4ed653196 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:41.167105 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-27843286-f216-4fb9-a6f2-16f4ed653196 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:41.893401 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f0c1e089-2524-44b6-96ce-8df1e5965b40 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:41.894851 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f0c1e089-2524-44b6-96ce-8df1e5965b40 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] [instance: c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:41.904730 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f0c1e089-2524-44b6-96ce-8df1e5965b40 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:41.906711 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f0c1e089-2524-44b6-96ce-8df1e5965b40 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:41.907708 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f0c1e089-2524-44b6-96ce-8df1e5965b40 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:41.908561 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f0c1e089-2524-44b6-96ce-8df1e5965b40 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:42.620246 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-27843286-f216-4fb9-a6f2-16f4ed653196 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:42.630497 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f0c1e089-2524-44b6-96ce-8df1e5965b40 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f451e0f5c945d8ade3c2a4ea3398c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09e491f80c24a2691e396df0175a057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:42.630821 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-27843286-f216-4fb9-a6f2-16f4ed653196 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:42.639283 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f0c1e089-2524-44b6-96ce-8df1e5965b40 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] 10.222.0.45 "GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33" status: 200 len: 1471 microversion: 2.1 time: 0.750363 Jun 16 12:30:42.646646 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-27843286-f216-4fb9-a6f2-16f4ed653196 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:42.648324 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-27843286-f216-4fb9-a6f2-16f4ed653196 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1806 microversion: 2.20 time: 1.507519 Jun 16 12:30:42.653841 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 288/581] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:30:41 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1806 bytes in 1514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:30:42.654024 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 294/582] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:41 2022] GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33 => generated 1471 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:30:42.676744 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-47b476c7-c8d9-4712-aeda-b2659223bf5f req-735a4276-e268-4015-81fa-54fd9ef42c12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33", "name": "network-vif-deleted", "tag": "ca9f1e0d-1fc3-43f4-8519-98d8014759c6"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:30:42.703798 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-47b476c7-c8d9-4712-aeda-b2659223bf5f req-735a4276-e268-4015-81fa-54fd9ef42c12 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:42.703798 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-47b476c7-c8d9-4712-aeda-b2659223bf5f req-735a4276-e268-4015-81fa-54fd9ef42c12 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:42.723696 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-47b476c7-c8d9-4712-aeda-b2659223bf5f req-735a4276-e268-4015-81fa-54fd9ef42c12 service nova] Creating event network-vif-deleted:ca9f1e0d-1fc3-43f4-8519-98d8014759c6 for instance c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33 on hv-cinder-84614 Jun 16 12:30:42.730995 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-47b476c7-c8d9-4712-aeda-b2659223bf5f req-735a4276-e268-4015-81fa-54fd9ef42c12 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074703 Jun 16 12:30:42.731354 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 295/583] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:30:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:30:43.663685 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-843f3387-ba6a-428d-89d5-81f611efec9a tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:43.665043 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-843f3387-ba6a-428d-89d5-81f611efec9a tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] [instance: c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:43.673496 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b09ec1a5-c229-4a13-9f6d-148c0a23e7b7 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:43.674227 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b09ec1a5-c229-4a13-9f6d-148c0a23e7b7 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:43.709058 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=88 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:30:43.716632 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b09ec1a5-c229-4a13-9f6d-148c0a23e7b7 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:43.717081 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b09ec1a5-c229-4a13-9f6d-148c0a23e7b7 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:43.717856 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b09ec1a5-c229-4a13-9f6d-148c0a23e7b7 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:43.726694 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b09ec1a5-c229-4a13-9f6d-148c0a23e7b7 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:43.738109 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-843f3387-ba6a-428d-89d5-81f611efec9a tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:43.738713 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-843f3387-ba6a-428d-89d5-81f611efec9a tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:43.741611 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-843f3387-ba6a-428d-89d5-81f611efec9a tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:43.742264 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-843f3387-ba6a-428d-89d5-81f611efec9a tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:44.026910 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-843f3387-ba6a-428d-89d5-81f611efec9a tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f451e0f5c945d8ade3c2a4ea3398c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09e491f80c24a2691e396df0175a057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:44.068987 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-843f3387-ba6a-428d-89d5-81f611efec9a tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] 10.222.0.45 "GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33" status: 200 len: 1471 microversion: 2.1 time: 0.410976 Jun 16 12:30:44.086831 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 289/584] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:43 2022] GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33 => generated 1471 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:30:44.191668 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b09ec1a5-c229-4a13-9f6d-148c0a23e7b7 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:44.204362 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b09ec1a5-c229-4a13-9f6d-148c0a23e7b7 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:44.210494 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b09ec1a5-c229-4a13-9f6d-148c0a23e7b7 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:44.214725 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b09ec1a5-c229-4a13-9f6d-148c0a23e7b7 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1806 microversion: 2.20 time: 0.546310 Jun 16 12:30:44.222030 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 296/585] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:30:43 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1806 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 12:30:44.862280 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-996d5302-bc93-4f89-af78-7760df694129 req-ffae0fa3-fc45-41fe-876d-d658c576267e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9abc4b09-7cfc-47dc-b778-684eb2e331b9", "tag": "00492cc8-699c-4660-9bfd-0cd1a05f4e44"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:30:44.887278 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-996d5302-bc93-4f89-af78-7760df694129 req-ffae0fa3-fc45-41fe-876d-d658c576267e service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:44.888091 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-996d5302-bc93-4f89-af78-7760df694129 req-ffae0fa3-fc45-41fe-876d-d658c576267e service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:44.918245 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-996d5302-bc93-4f89-af78-7760df694129 req-ffae0fa3-fc45-41fe-876d-d658c576267e service nova] Creating event network-changed:00492cc8-699c-4660-9bfd-0cd1a05f4e44 for instance 9abc4b09-7cfc-47dc-b778-684eb2e331b9 on hv-cinder-84614 Jun 16 12:30:44.928974 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-996d5302-bc93-4f89-af78-7760df694129 req-ffae0fa3-fc45-41fe-876d-d658c576267e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069295 Jun 16 12:30:44.932305 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 290/586] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:30:45.101993 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d69264e2-4205-467c-9859-9d9f53d7ad72 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:45.102736 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d69264e2-4205-467c-9859-9d9f53d7ad72 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] [instance: c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:45.114938 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d69264e2-4205-467c-9859-9d9f53d7ad72 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:45.115388 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d69264e2-4205-467c-9859-9d9f53d7ad72 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:45.121701 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d69264e2-4205-467c-9859-9d9f53d7ad72 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:45.122432 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d69264e2-4205-467c-9859-9d9f53d7ad72 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:45.203689 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d69264e2-4205-467c-9859-9d9f53d7ad72 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f451e0f5c945d8ade3c2a4ea3398c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09e491f80c24a2691e396df0175a057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:45.215110 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d69264e2-4205-467c-9859-9d9f53d7ad72 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] 10.222.0.45 "GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33" status: 200 len: 1471 microversion: 2.1 time: 0.126820 Jun 16 12:30:45.215700 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 297/587] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:45 2022] GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33 => generated 1471 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:30:45.244658 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a2e751d1-f7f4-4c39-a826-018ce916545c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:45.245702 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a2e751d1-f7f4-4c39-a826-018ce916545c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:45.256446 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a2e751d1-f7f4-4c39-a826-018ce916545c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:45.257301 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a2e751d1-f7f4-4c39-a826-018ce916545c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:45.258993 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a2e751d1-f7f4-4c39-a826-018ce916545c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:45.260155 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a2e751d1-f7f4-4c39-a826-018ce916545c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:45.521654 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a2e751d1-f7f4-4c39-a826-018ce916545c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:45.532206 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a2e751d1-f7f4-4c39-a826-018ce916545c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:45.534183 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a2e751d1-f7f4-4c39-a826-018ce916545c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:45.535623 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a2e751d1-f7f4-4c39-a826-018ce916545c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1806 microversion: 2.20 time: 0.296488 Jun 16 12:30:45.545922 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 291/588] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:30:45 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1806 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:30:46.244710 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-42105315-c42e-46a0-a33f-9610f88b52da tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:46.246174 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-42105315-c42e-46a0-a33f-9610f88b52da tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] [instance: c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:46.253911 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-42105315-c42e-46a0-a33f-9610f88b52da tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:46.254722 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-42105315-c42e-46a0-a33f-9610f88b52da tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:46.255769 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-42105315-c42e-46a0-a33f-9610f88b52da tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:46.256420 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-42105315-c42e-46a0-a33f-9610f88b52da tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:46.357513 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-42105315-c42e-46a0-a33f-9610f88b52da tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f451e0f5c945d8ade3c2a4ea3398c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09e491f80c24a2691e396df0175a057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:46.390723 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-42105315-c42e-46a0-a33f-9610f88b52da tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] 10.222.0.45 "GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33" status: 200 len: 1471 microversion: 2.1 time: 0.151466 Jun 16 12:30:46.391921 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 298/589] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:46 2022] GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33 => generated 1471 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:30:46.569458 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ceb67b57-9f36-4e3b-aa1f-1687d4c70eb6 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:46.570158 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ceb67b57-9f36-4e3b-aa1f-1687d4c70eb6 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:46.589899 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ceb67b57-9f36-4e3b-aa1f-1687d4c70eb6 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:46.589899 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ceb67b57-9f36-4e3b-aa1f-1687d4c70eb6 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:46.593842 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ceb67b57-9f36-4e3b-aa1f-1687d4c70eb6 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:46.594897 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ceb67b57-9f36-4e3b-aa1f-1687d4c70eb6 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:46.856970 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ceb67b57-9f36-4e3b-aa1f-1687d4c70eb6 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:46.870090 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ceb67b57-9f36-4e3b-aa1f-1687d4c70eb6 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:46.871663 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ceb67b57-9f36-4e3b-aa1f-1687d4c70eb6 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:46.872867 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ceb67b57-9f36-4e3b-aa1f-1687d4c70eb6 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1806 microversion: 2.20 time: 0.319172 Jun 16 12:30:46.875625 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 292/590] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:30:46 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1806 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:30:47.412201 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e60161af-8b34-450a-83de-9d669f047e12 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:47.414197 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e60161af-8b34-450a-83de-9d669f047e12 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] [instance: c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:47.429728 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e60161af-8b34-450a-83de-9d669f047e12 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:47.430554 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e60161af-8b34-450a-83de-9d669f047e12 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:47.431709 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e60161af-8b34-450a-83de-9d669f047e12 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:47.432423 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e60161af-8b34-450a-83de-9d669f047e12 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:47.544403 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e60161af-8b34-450a-83de-9d669f047e12 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f451e0f5c945d8ade3c2a4ea3398c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09e491f80c24a2691e396df0175a057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:47.572081 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e60161af-8b34-450a-83de-9d669f047e12 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] 10.222.0.45 "GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33" status: 200 len: 1471 microversion: 2.1 time: 0.166851 Jun 16 12:30:47.573085 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 299/591] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:47 2022] GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33 => generated 1471 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:30:47.902130 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-02bf7b16-dd25-4ff3-bb24-7acce3b47086 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:47.903841 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-02bf7b16-dd25-4ff3-bb24-7acce3b47086 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:47.913362 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-02bf7b16-dd25-4ff3-bb24-7acce3b47086 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:47.918187 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-02bf7b16-dd25-4ff3-bb24-7acce3b47086 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:47.919702 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-02bf7b16-dd25-4ff3-bb24-7acce3b47086 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:47.920602 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-02bf7b16-dd25-4ff3-bb24-7acce3b47086 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:48.216486 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-02bf7b16-dd25-4ff3-bb24-7acce3b47086 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:48.225581 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-02bf7b16-dd25-4ff3-bb24-7acce3b47086 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:48.229415 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-02bf7b16-dd25-4ff3-bb24-7acce3b47086 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:48.231491 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-02bf7b16-dd25-4ff3-bb24-7acce3b47086 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1806 microversion: 2.20 time: 0.340614 Jun 16 12:30:48.238335 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 293/592] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:30:47 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1806 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:30:48.614324 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-cee1f81a-ad29-40e2-88cd-2d549eb50741 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:48.638848 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-cee1f81a-ad29-40e2-88cd-2d549eb50741 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] [instance: c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:48.653356 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cee1f81a-ad29-40e2-88cd-2d549eb50741 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:48.680092 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cee1f81a-ad29-40e2-88cd-2d549eb50741 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:48.687560 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cee1f81a-ad29-40e2-88cd-2d549eb50741 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:48.688539 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cee1f81a-ad29-40e2-88cd-2d549eb50741 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:48.797840 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-cee1f81a-ad29-40e2-88cd-2d549eb50741 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f451e0f5c945d8ade3c2a4ea3398c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09e491f80c24a2691e396df0175a057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:48.810436 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-cee1f81a-ad29-40e2-88cd-2d549eb50741 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] 10.222.0.45 "GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33" status: 200 len: 1471 microversion: 2.1 time: 0.203454 Jun 16 12:30:48.811612 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 300/593] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:48 2022] GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33 => generated 1471 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:30:49.251963 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2def986e-89e9-48b8-8109-6ebca5efcc2e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:49.252624 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2def986e-89e9-48b8-8109-6ebca5efcc2e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:49.264568 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2def986e-89e9-48b8-8109-6ebca5efcc2e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:49.264568 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2def986e-89e9-48b8-8109-6ebca5efcc2e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:49.264868 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2def986e-89e9-48b8-8109-6ebca5efcc2e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:49.265175 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2def986e-89e9-48b8-8109-6ebca5efcc2e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:49.590906 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2def986e-89e9-48b8-8109-6ebca5efcc2e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:49.609480 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2def986e-89e9-48b8-8109-6ebca5efcc2e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:49.613568 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2def986e-89e9-48b8-8109-6ebca5efcc2e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:49.614834 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2def986e-89e9-48b8-8109-6ebca5efcc2e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1806 microversion: 2.20 time: 0.367591 Jun 16 12:30:49.615385 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 294/594] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:30:49 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1806 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:30:49.832295 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-59a5f7f5-cd0f-4004-82a7-3f6aa47d7ad7 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:49.833459 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-59a5f7f5-cd0f-4004-82a7-3f6aa47d7ad7 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] [instance: c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:49.845302 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-59a5f7f5-cd0f-4004-82a7-3f6aa47d7ad7 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:49.845754 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-59a5f7f5-cd0f-4004-82a7-3f6aa47d7ad7 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:49.848045 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-59a5f7f5-cd0f-4004-82a7-3f6aa47d7ad7 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:49.855600 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-59a5f7f5-cd0f-4004-82a7-3f6aa47d7ad7 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:49.972099 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-59a5f7f5-cd0f-4004-82a7-3f6aa47d7ad7 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f451e0f5c945d8ade3c2a4ea3398c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09e491f80c24a2691e396df0175a057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:49.981323 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-59a5f7f5-cd0f-4004-82a7-3f6aa47d7ad7 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] 10.222.0.45 "GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33" status: 200 len: 1471 microversion: 2.1 time: 0.156786 Jun 16 12:30:49.986015 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 301/595] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:49 2022] GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33 => generated 1471 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:30:50.636698 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7d583820-5d1e-4fd1-8f6c-446154030c14 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:50.637272 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7d583820-5d1e-4fd1-8f6c-446154030c14 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:50.649102 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7d583820-5d1e-4fd1-8f6c-446154030c14 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:50.650102 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7d583820-5d1e-4fd1-8f6c-446154030c14 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:50.651464 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7d583820-5d1e-4fd1-8f6c-446154030c14 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:50.651464 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7d583820-5d1e-4fd1-8f6c-446154030c14 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:50.851061 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7d583820-5d1e-4fd1-8f6c-446154030c14 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:50.872384 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7d583820-5d1e-4fd1-8f6c-446154030c14 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:50.876306 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7d583820-5d1e-4fd1-8f6c-446154030c14 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:50.877634 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7d583820-5d1e-4fd1-8f6c-446154030c14 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1806 microversion: 2.20 time: 0.245728 Jun 16 12:30:50.878735 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 295/596] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:30:50 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1806 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:30:50.999828 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-cc646fcf-5789-4cc4-abc8-05df367a89e0 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:51.001182 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-cc646fcf-5789-4cc4-abc8-05df367a89e0 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] [instance: c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:51.019988 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cc646fcf-5789-4cc4-abc8-05df367a89e0 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:51.020432 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cc646fcf-5789-4cc4-abc8-05df367a89e0 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:51.021391 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cc646fcf-5789-4cc4-abc8-05df367a89e0 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:51.022023 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cc646fcf-5789-4cc4-abc8-05df367a89e0 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:51.137487 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-cc646fcf-5789-4cc4-abc8-05df367a89e0 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f451e0f5c945d8ade3c2a4ea3398c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09e491f80c24a2691e396df0175a057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:51.147544 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-cc646fcf-5789-4cc4-abc8-05df367a89e0 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] 10.222.0.45 "GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33" status: 200 len: 1471 microversion: 2.1 time: 0.152085 Jun 16 12:30:51.148671 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 302/597] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:50 2022] GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33 => generated 1471 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:30:51.919534 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4af4f21b-c3cb-4486-a413-27e755dd9d1d tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:51.923790 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4af4f21b-c3cb-4486-a413-27e755dd9d1d tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:51.949458 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4af4f21b-c3cb-4486-a413-27e755dd9d1d tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:51.950818 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4af4f21b-c3cb-4486-a413-27e755dd9d1d tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:51.952346 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4af4f21b-c3cb-4486-a413-27e755dd9d1d tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:51.954977 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4af4f21b-c3cb-4486-a413-27e755dd9d1d tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:52.174523 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-cefd4c30-aa6a-4c55-8471-68f95307b3d9 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:52.176763 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-cefd4c30-aa6a-4c55-8471-68f95307b3d9 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] [instance: c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:52.205044 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cefd4c30-aa6a-4c55-8471-68f95307b3d9 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:52.205826 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cefd4c30-aa6a-4c55-8471-68f95307b3d9 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:52.206839 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cefd4c30-aa6a-4c55-8471-68f95307b3d9 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:52.207518 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cefd4c30-aa6a-4c55-8471-68f95307b3d9 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:52.309737 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-cefd4c30-aa6a-4c55-8471-68f95307b3d9 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f451e0f5c945d8ade3c2a4ea3398c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09e491f80c24a2691e396df0175a057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:52.322594 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-cefd4c30-aa6a-4c55-8471-68f95307b3d9 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] 10.222.0.45 "GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33" status: 200 len: 1471 microversion: 2.1 time: 0.158293 Jun 16 12:30:52.323850 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 303/598] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:52 2022] GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33 => generated 1471 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:30:52.363496 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4af4f21b-c3cb-4486-a413-27e755dd9d1d tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:52.404053 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4af4f21b-c3cb-4486-a413-27e755dd9d1d tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:52.426077 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4af4f21b-c3cb-4486-a413-27e755dd9d1d tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:52.426077 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4af4f21b-c3cb-4486-a413-27e755dd9d1d tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1806 microversion: 2.20 time: 0.514747 Jun 16 12:30:52.435329 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 296/599] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:30:51 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1806 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:30:53.343061 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d7b4b4e5-7a5e-49fc-ba0c-e3016c372602 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:53.343725 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d7b4b4e5-7a5e-49fc-ba0c-e3016c372602 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] [instance: c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:53.359556 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d7b4b4e5-7a5e-49fc-ba0c-e3016c372602 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:53.359971 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d7b4b4e5-7a5e-49fc-ba0c-e3016c372602 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:53.363519 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d7b4b4e5-7a5e-49fc-ba0c-e3016c372602 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:53.363993 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d7b4b4e5-7a5e-49fc-ba0c-e3016c372602 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:53.443014 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-aff1053c-b84a-4fa1-9f63-4c3de91358b5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:53.443623 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-aff1053c-b84a-4fa1-9f63-4c3de91358b5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:53.463709 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-aff1053c-b84a-4fa1-9f63-4c3de91358b5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:53.464636 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-aff1053c-b84a-4fa1-9f63-4c3de91358b5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:53.465996 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-aff1053c-b84a-4fa1-9f63-4c3de91358b5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:53.466922 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-aff1053c-b84a-4fa1-9f63-4c3de91358b5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:53.497783 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d7b4b4e5-7a5e-49fc-ba0c-e3016c372602 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f451e0f5c945d8ade3c2a4ea3398c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09e491f80c24a2691e396df0175a057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:53.509733 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d7b4b4e5-7a5e-49fc-ba0c-e3016c372602 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] 10.222.0.45 "GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33" status: 200 len: 1471 microversion: 2.1 time: 0.171896 Jun 16 12:30:53.521245 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 304/600] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:53 2022] GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33 => generated 1471 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:30:53.675498 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-aff1053c-b84a-4fa1-9f63-4c3de91358b5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:53.687470 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-aff1053c-b84a-4fa1-9f63-4c3de91358b5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:53.689137 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-aff1053c-b84a-4fa1-9f63-4c3de91358b5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:53.690374 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-aff1053c-b84a-4fa1-9f63-4c3de91358b5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1806 microversion: 2.20 time: 0.251507 Jun 16 12:30:53.691149 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 297/601] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:30:53 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1806 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 12:30:54.530016 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-cb2066cb-c571-489f-aa5b-269c3d8314d5 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:54.532477 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-cb2066cb-c571-489f-aa5b-269c3d8314d5 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] [instance: c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:54.541910 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cb2066cb-c571-489f-aa5b-269c3d8314d5 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:54.543355 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cb2066cb-c571-489f-aa5b-269c3d8314d5 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:54.544149 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cb2066cb-c571-489f-aa5b-269c3d8314d5 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:54.544590 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cb2066cb-c571-489f-aa5b-269c3d8314d5 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:54.690577 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-cb2066cb-c571-489f-aa5b-269c3d8314d5 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f451e0f5c945d8ade3c2a4ea3398c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09e491f80c24a2691e396df0175a057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:54.699702 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-cb2066cb-c571-489f-aa5b-269c3d8314d5 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] 10.222.0.45 "GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33" status: 200 len: 1471 microversion: 2.1 time: 0.174425 Jun 16 12:30:54.701533 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 305/602] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:54 2022] GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33 => generated 1471 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:30:54.736097 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a9f56dcd-56b9-4f52-9457-2ce5b7dc3420 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:54.736904 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a9f56dcd-56b9-4f52-9457-2ce5b7dc3420 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:54.746211 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a9f56dcd-56b9-4f52-9457-2ce5b7dc3420 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:54.746715 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a9f56dcd-56b9-4f52-9457-2ce5b7dc3420 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:54.747529 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a9f56dcd-56b9-4f52-9457-2ce5b7dc3420 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:54.748072 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a9f56dcd-56b9-4f52-9457-2ce5b7dc3420 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:55.111281 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a9f56dcd-56b9-4f52-9457-2ce5b7dc3420 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:55.129113 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a9f56dcd-56b9-4f52-9457-2ce5b7dc3420 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:55.130661 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a9f56dcd-56b9-4f52-9457-2ce5b7dc3420 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:55.131844 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a9f56dcd-56b9-4f52-9457-2ce5b7dc3420 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1806 microversion: 2.20 time: 0.410657 Jun 16 12:30:55.132859 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 298/603] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:30:54 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1806 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:30:55.722765 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-46a2e807-e913-4ae7-b739-0ba729a16d56 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:55.723451 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-46a2e807-e913-4ae7-b739-0ba729a16d56 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] [instance: c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:55.741513 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-46a2e807-e913-4ae7-b739-0ba729a16d56 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:55.742458 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-46a2e807-e913-4ae7-b739-0ba729a16d56 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:55.744841 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-46a2e807-e913-4ae7-b739-0ba729a16d56 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:55.747146 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-46a2e807-e913-4ae7-b739-0ba729a16d56 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:55.841008 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-46a2e807-e913-4ae7-b739-0ba729a16d56 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f451e0f5c945d8ade3c2a4ea3398c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09e491f80c24a2691e396df0175a057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:55.851897 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-46a2e807-e913-4ae7-b739-0ba729a16d56 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] 10.222.0.45 "GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33" status: 200 len: 1471 microversion: 2.1 time: 0.136118 Jun 16 12:30:55.853154 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 306/604] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:55 2022] GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33 => generated 1471 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:30:56.152287 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5a035adf-9ed3-464d-b1cf-a3031b317ac8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:56.152902 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5a035adf-9ed3-464d-b1cf-a3031b317ac8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:56.162436 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5a035adf-9ed3-464d-b1cf-a3031b317ac8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:56.163035 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5a035adf-9ed3-464d-b1cf-a3031b317ac8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:56.164283 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5a035adf-9ed3-464d-b1cf-a3031b317ac8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:56.166461 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5a035adf-9ed3-464d-b1cf-a3031b317ac8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:56.392085 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5a035adf-9ed3-464d-b1cf-a3031b317ac8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:56.405185 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5a035adf-9ed3-464d-b1cf-a3031b317ac8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:56.421915 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5a035adf-9ed3-464d-b1cf-a3031b317ac8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:56.421915 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5a035adf-9ed3-464d-b1cf-a3031b317ac8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1806 microversion: 2.20 time: 0.272777 Jun 16 12:30:56.433085 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 299/605] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:30:56 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1806 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:30:56.872212 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a7368e5e-3835-4705-a51a-bda3acd46afa tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:56.872212 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a7368e5e-3835-4705-a51a-bda3acd46afa tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] [instance: c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:56.879384 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a7368e5e-3835-4705-a51a-bda3acd46afa tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:56.879835 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a7368e5e-3835-4705-a51a-bda3acd46afa tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:56.880920 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a7368e5e-3835-4705-a51a-bda3acd46afa tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:56.881356 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a7368e5e-3835-4705-a51a-bda3acd46afa tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:56.965610 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a7368e5e-3835-4705-a51a-bda3acd46afa tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f451e0f5c945d8ade3c2a4ea3398c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09e491f80c24a2691e396df0175a057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:56.973325 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a7368e5e-3835-4705-a51a-bda3acd46afa tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] 10.222.0.45 "GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33" status: 200 len: 1471 microversion: 2.1 time: 0.107169 Jun 16 12:30:56.982795 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 307/606] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:56 2022] GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33 => generated 1471 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:30:57.439314 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-01c9db63-9fbc-469a-8393-6711def11363 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:57.439986 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-01c9db63-9fbc-469a-8393-6711def11363 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:57.447639 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-01c9db63-9fbc-469a-8393-6711def11363 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:57.448080 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-01c9db63-9fbc-469a-8393-6711def11363 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:57.448834 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-01c9db63-9fbc-469a-8393-6711def11363 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:57.449265 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-01c9db63-9fbc-469a-8393-6711def11363 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:57.467359 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:30:57.595175 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-01c9db63-9fbc-469a-8393-6711def11363 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:57.603911 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-01c9db63-9fbc-469a-8393-6711def11363 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:57.605501 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-01c9db63-9fbc-469a-8393-6711def11363 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:57.606787 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-01c9db63-9fbc-469a-8393-6711def11363 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1806 microversion: 2.20 time: 0.171369 Jun 16 12:30:57.607421 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 300/607] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:30:57 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1806 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:30:57.991725 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-dfcacb65-787b-4823-9e8a-d8627ebc68ae tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:57.992342 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-dfcacb65-787b-4823-9e8a-d8627ebc68ae tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] [instance: c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:57.999052 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dfcacb65-787b-4823-9e8a-d8627ebc68ae tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:57.999501 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dfcacb65-787b-4823-9e8a-d8627ebc68ae tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:58.000268 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dfcacb65-787b-4823-9e8a-d8627ebc68ae tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:58.000705 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dfcacb65-787b-4823-9e8a-d8627ebc68ae tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:58.061975 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-dfcacb65-787b-4823-9e8a-d8627ebc68ae tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f451e0f5c945d8ade3c2a4ea3398c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09e491f80c24a2691e396df0175a057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:58.069410 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-dfcacb65-787b-4823-9e8a-d8627ebc68ae tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] 10.222.0.45 "GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33" status: 200 len: 1471 microversion: 2.1 time: 0.082483 Jun 16 12:30:58.069988 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 308/608] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:57 2022] GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33 => generated 1471 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:30:58.624833 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f2d19fe6-7a3c-4982-b952-037264b56d91 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:58.625472 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f2d19fe6-7a3c-4982-b952-037264b56d91 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:58.631968 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f2d19fe6-7a3c-4982-b952-037264b56d91 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:58.632411 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f2d19fe6-7a3c-4982-b952-037264b56d91 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:58.633788 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f2d19fe6-7a3c-4982-b952-037264b56d91 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:58.634486 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f2d19fe6-7a3c-4982-b952-037264b56d91 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:58.766897 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f2d19fe6-7a3c-4982-b952-037264b56d91 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:58.776409 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f2d19fe6-7a3c-4982-b952-037264b56d91 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:58.778403 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f2d19fe6-7a3c-4982-b952-037264b56d91 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:58.779443 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f2d19fe6-7a3c-4982-b952-037264b56d91 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1806 microversion: 2.20 time: 0.158629 Jun 16 12:30:58.779999 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 301/609] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:30:58 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1806 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 12:30:59.086338 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-df75a6c4-53e3-49c4-80ae-42e5d1029ad6 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:59.088393 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-df75a6c4-53e3-49c4-80ae-42e5d1029ad6 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] [instance: c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:59.093470 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-df75a6c4-53e3-49c4-80ae-42e5d1029ad6 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:59.093945 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-df75a6c4-53e3-49c4-80ae-42e5d1029ad6 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:59.094791 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-df75a6c4-53e3-49c4-80ae-42e5d1029ad6 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:59.095231 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-df75a6c4-53e3-49c4-80ae-42e5d1029ad6 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:59.163106 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-df75a6c4-53e3-49c4-80ae-42e5d1029ad6 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f451e0f5c945d8ade3c2a4ea3398c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09e491f80c24a2691e396df0175a057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:59.166060 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:30:59.172514 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-df75a6c4-53e3-49c4-80ae-42e5d1029ad6 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] 10.222.0.45 "GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33" status: 200 len: 1471 microversion: 2.1 time: 0.090147 Jun 16 12:30:59.173087 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 309/610] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:30:59 2022] GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33 => generated 1471 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:30:59.798429 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-14abfd5c-e56f-4c53-9da7-6fa4fb1d8901 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:30:59.799165 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-14abfd5c-e56f-4c53-9da7-6fa4fb1d8901 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:30:59.806083 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-14abfd5c-e56f-4c53-9da7-6fa4fb1d8901 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:59.806643 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-14abfd5c-e56f-4c53-9da7-6fa4fb1d8901 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:59.807416 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-14abfd5c-e56f-4c53-9da7-6fa4fb1d8901 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:30:59.807928 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-14abfd5c-e56f-4c53-9da7-6fa4fb1d8901 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:30:59.936142 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-14abfd5c-e56f-4c53-9da7-6fa4fb1d8901 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:59.944457 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-14abfd5c-e56f-4c53-9da7-6fa4fb1d8901 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:59.946273 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-14abfd5c-e56f-4c53-9da7-6fa4fb1d8901 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:30:59.947336 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-14abfd5c-e56f-4c53-9da7-6fa4fb1d8901 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1806 microversion: 2.20 time: 0.152807 Jun 16 12:30:59.947893 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 302/611] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:30:59 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1806 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:31:00.190283 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-fb29b9e4-b230-4fb1-a876-bed7ec8deca4 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:31:00.190933 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-fb29b9e4-b230-4fb1-a876-bed7ec8deca4 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] [instance: c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:31:00.197300 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fb29b9e4-b230-4fb1-a876-bed7ec8deca4 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:31:00.197744 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fb29b9e4-b230-4fb1-a876-bed7ec8deca4 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:31:00.198544 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fb29b9e4-b230-4fb1-a876-bed7ec8deca4 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:31:00.198988 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fb29b9e4-b230-4fb1-a876-bed7ec8deca4 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:31:00.230466 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fb29b9e4-b230-4fb1-a876-bed7ec8deca4 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:31:00.230917 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fb29b9e4-b230-4fb1-a876-bed7ec8deca4 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:31:00.231380 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.objects.instance [None req-fb29b9e4-b230-4fb1-a876-bed7ec8deca4 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lazy-loading 'fault' on Instance uuid c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33 {{(pid=117607) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 12:31:00.278913 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-fb29b9e4-b230-4fb1-a876-bed7ec8deca4 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f451e0f5c945d8ade3c2a4ea3398c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09e491f80c24a2691e396df0175a057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:31:00.286497 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-fb29b9e4-b230-4fb1-a876-bed7ec8deca4 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] 10.222.0.45 "GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33" status: 200 len: 1309 microversion: 2.1 time: 0.100025 Jun 16 12:31:00.287075 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 310/612] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:31:00 2022] GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33 => generated 1309 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:31:00.969014 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-66cba0f1-920b-4812-a836-a96a7d44cf2a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:31:00.970361 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-66cba0f1-920b-4812-a836-a96a7d44cf2a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:31:00.983266 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-66cba0f1-920b-4812-a836-a96a7d44cf2a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:31:00.984059 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-66cba0f1-920b-4812-a836-a96a7d44cf2a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:31:00.985412 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-66cba0f1-920b-4812-a836-a96a7d44cf2a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:31:00.986221 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-66cba0f1-920b-4812-a836-a96a7d44cf2a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:31:01.181713 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-66cba0f1-920b-4812-a836-a96a7d44cf2a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:31:01.190164 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-66cba0f1-920b-4812-a836-a96a7d44cf2a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:31:01.191692 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-66cba0f1-920b-4812-a836-a96a7d44cf2a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:31:01.192846 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-66cba0f1-920b-4812-a836-a96a7d44cf2a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1806 microversion: 2.20 time: 0.229566 Jun 16 12:31:01.193395 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 303/613] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:31:00 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1806 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:31:01.303131 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e7357903-ffab-4a20-9fc9-ed10193944e2 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:31:01.303739 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e7357903-ffab-4a20-9fc9-ed10193944e2 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] [instance: c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:31:01.310691 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e7357903-ffab-4a20-9fc9-ed10193944e2 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:31:01.311144 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e7357903-ffab-4a20-9fc9-ed10193944e2 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:31:01.311885 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e7357903-ffab-4a20-9fc9-ed10193944e2 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:31:01.312318 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e7357903-ffab-4a20-9fc9-ed10193944e2 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:31:01.343000 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e7357903-ffab-4a20-9fc9-ed10193944e2 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:31:01.343449 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e7357903-ffab-4a20-9fc9-ed10193944e2 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:31:01.344004 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.objects.instance [None req-e7357903-ffab-4a20-9fc9-ed10193944e2 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lazy-loading 'fault' on Instance uuid c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33 {{(pid=117607) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 12:31:01.418272 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e7357903-ffab-4a20-9fc9-ed10193944e2 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f451e0f5c945d8ade3c2a4ea3398c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09e491f80c24a2691e396df0175a057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:31:01.428564 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e7357903-ffab-4a20-9fc9-ed10193944e2 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] 10.222.0.45 "GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33" status: 200 len: 1309 microversion: 2.1 time: 0.129328 Jun 16 12:31:01.430237 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 311/614] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:31:01 2022] GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33 => generated 1309 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:31:02.211830 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a2b08de5-927d-45b1-9800-ac3472daa911 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:31:02.212799 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a2b08de5-927d-45b1-9800-ac3472daa911 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:31:02.219966 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a2b08de5-927d-45b1-9800-ac3472daa911 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:31:02.220413 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a2b08de5-927d-45b1-9800-ac3472daa911 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:31:02.221198 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a2b08de5-927d-45b1-9800-ac3472daa911 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:31:02.221634 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a2b08de5-927d-45b1-9800-ac3472daa911 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:31:02.351658 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a2b08de5-927d-45b1-9800-ac3472daa911 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:31:02.361284 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a2b08de5-927d-45b1-9800-ac3472daa911 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:31:02.362820 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a2b08de5-927d-45b1-9800-ac3472daa911 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:31:02.364008 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a2b08de5-927d-45b1-9800-ac3472daa911 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1806 microversion: 2.20 time: 0.156327 Jun 16 12:31:02.364556 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 304/615] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:31:02 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1806 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:31:02.444298 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b3dbbb8d-2cef-4fc3-843f-f53219e4908f tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:31:02.444912 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b3dbbb8d-2cef-4fc3-843f-f53219e4908f tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] [instance: c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:31:02.451515 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b3dbbb8d-2cef-4fc3-843f-f53219e4908f tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:31:02.452000 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b3dbbb8d-2cef-4fc3-843f-f53219e4908f tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:31:02.453028 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b3dbbb8d-2cef-4fc3-843f-f53219e4908f tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:31:02.453400 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b3dbbb8d-2cef-4fc3-843f-f53219e4908f tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:31:02.485749 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b3dbbb8d-2cef-4fc3-843f-f53219e4908f tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:31:02.486230 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b3dbbb8d-2cef-4fc3-843f-f53219e4908f tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:31:02.486979 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.objects.instance [None req-b3dbbb8d-2cef-4fc3-843f-f53219e4908f tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lazy-loading 'fault' on Instance uuid c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33 {{(pid=117607) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 12:31:02.535459 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b3dbbb8d-2cef-4fc3-843f-f53219e4908f tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f451e0f5c945d8ade3c2a4ea3398c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09e491f80c24a2691e396df0175a057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:31:02.544585 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b3dbbb8d-2cef-4fc3-843f-f53219e4908f tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] 10.222.0.45 "GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33" status: 200 len: 1309 microversion: 2.1 time: 0.104030 Jun 16 12:31:02.545165 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 312/616] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:31:02 2022] GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33 => generated 1309 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:31:03.382336 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5b5f9385-692f-49e5-827e-61a77014a009 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:31:03.383661 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5b5f9385-692f-49e5-827e-61a77014a009 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:31:03.390000 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5b5f9385-692f-49e5-827e-61a77014a009 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:31:03.390449 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5b5f9385-692f-49e5-827e-61a77014a009 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:31:03.391206 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5b5f9385-692f-49e5-827e-61a77014a009 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:31:03.391663 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5b5f9385-692f-49e5-827e-61a77014a009 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:31:03.561294 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ac5ed267-4c33-492d-be98-1fe0ce9e660c tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:31:03.561924 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ac5ed267-4c33-492d-be98-1fe0ce9e660c tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] [instance: c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:31:03.568939 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ac5ed267-4c33-492d-be98-1fe0ce9e660c tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:31:03.569461 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ac5ed267-4c33-492d-be98-1fe0ce9e660c tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:31:03.570354 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ac5ed267-4c33-492d-be98-1fe0ce9e660c tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:31:03.571494 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ac5ed267-4c33-492d-be98-1fe0ce9e660c tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:31:03.587762 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-ac5ed267-4c33-492d-be98-1fe0ce9e660c tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] HTTP exception thrown: Instance c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33 could not be found. Jun 16 12:31:03.589553 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ac5ed267-4c33-492d-be98-1fe0ce9e660c tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Request method failure captured: Jun 16 12:31:03.589553 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: request: GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33 HTTP/1.1 Jun 16 12:31:03.589553 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Accept: application/json Jun 16 12:31:03.589553 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jun 16 12:31:03.589553 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Connection: close Jun 16 12:31:03.589553 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jun 16 12:31:03.589553 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jun 16 12:31:03.589553 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Host: 10.222.0.45 Jun 16 12:31:03.589553 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jun 16 12:31:03.589553 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jun 16 12:31:03.589553 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABiqyIJ5HzBoXNVtm1tcKnQsP9BeBPzcsI6z9e0O99bbDVVfnscfWoxVKzm5yn4Sc3L7NPXP7gXdU4K5aIQkvSdgd4mkdE3ksvYZWJgknSpxdgxuY7AZvLBwpS91ycQcJvlMrBrf9J3y2wh4lomIJdrpezT1exHzzfP522ICi-FTqptgLc Jun 16 12:31:03.589553 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jun 16 12:31:03.589553 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jun 16 12:31:03.589553 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jun 16 12:31:03.589553 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jun 16 12:31:03.589553 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jun 16 12:31:03.589553 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jun 16 12:31:03.589553 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Id: b09e491f80c24a2691e396df0175a057 Jun 16 12:31:03.589553 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1226929550 Jun 16 12:31:03.589553 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Role: member,reader Jun 16 12:31:03.589553 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Roles: member,reader Jun 16 12:31:03.591145 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/b09e491f80c24a2691e396df0175a057"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b09e491f80c24a2691e396df0175a057"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_b09e491f80c24a2691e396df0175a057"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b09e491f80c24a2691e396df0175a057"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Jun 16 12:31:03.591145 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-VolumesSnapshotTestJSON-1226929550 Jun 16 12:31:03.591145 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant-Id: b09e491f80c24a2691e396df0175a057 Jun 16 12:31:03.591145 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1226929550 Jun 16 12:31:03.591145 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User: tempest-VolumesSnapshotTestJSON-1226929550-project Jun 16 12:31:03.591145 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jun 16 12:31:03.591145 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jun 16 12:31:03.591145 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Id: b5f451e0f5c945d8ade3c2a4ea3398c2 Jun 16 12:31:03.591145 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-VolumesSnapshotTestJSON-1226929550-project Jun 16 12:31:03.591145 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: method: > Jun 16 12:31:03.591145 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: exception: Instance c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33 could not be found. Jun 16 12:31:03.591145 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: action_args: {'id': 'c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33'} Jun 16 12:31:03.592077 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:31:03.592077 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:31:03.592077 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:31:03.592077 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:31:03.592077 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:31:03.592077 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:31:03.592077 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:31:03.592077 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:31:03.592077 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:31:03.592077 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:31:03.592077 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33 could not be found. Jun 16 12:31:03.592077 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:31:03.592077 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:31:03.592077 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:31:03.592077 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:31:03.592077 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:31:03.592077 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:31:03.592077 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:31:03.592077 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:31:03.592077 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:31:03.593475 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:31:03.593475 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 12:31:03.593475 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 12:31:03.593475 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:31:03.593475 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:31:03.593475 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:31:03.593475 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:31:03.593475 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33 could not be found. Jun 16 12:31:03.593475 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:31:03.593475 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:31:03.593475 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:31:03.593475 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:31:03.593475 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:31:03.593475 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:31:03.593475 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:31:03.593475 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:31:03.593475 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33 could not be found. Jun 16 12:31:03.593475 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:31:03.594687 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ac5ed267-4c33-492d-be98-1fe0ce9e660c tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Returning 404 to user: Instance c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33 could not be found. {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:31:03.594687 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ac5ed267-4c33-492d-be98-1fe0ce9e660c tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] 10.222.0.45 "GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33" status: 404 len: 111 microversion: 2.1 time: 0.033635 Jun 16 12:31:03.594687 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 313/617] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:31:03 2022] GET /compute/v2.1/servers/c08ddb4d-afaa-4e3d-9a38-1fd015d7ef33 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 12:31:03.620885 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5b5f9385-692f-49e5-827e-61a77014a009 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:31:03.629674 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5b5f9385-692f-49e5-827e-61a77014a009 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:31:03.631223 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5b5f9385-692f-49e5-827e-61a77014a009 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:31:03.632413 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5b5f9385-692f-49e5-827e-61a77014a009 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1806 microversion: 2.20 time: 0.253960 Jun 16 12:31:03.638615 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 305/618] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:31:03 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1806 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:31:04.652024 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8ea00412-dd3d-4edd-b239-003085682f6c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:31:04.652830 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8ea00412-dd3d-4edd-b239-003085682f6c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:31:04.659638 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8ea00412-dd3d-4edd-b239-003085682f6c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:31:04.660082 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8ea00412-dd3d-4edd-b239-003085682f6c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:31:04.660846 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8ea00412-dd3d-4edd-b239-003085682f6c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:31:04.661279 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8ea00412-dd3d-4edd-b239-003085682f6c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:31:04.792253 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8ea00412-dd3d-4edd-b239-003085682f6c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:31:04.800721 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8ea00412-dd3d-4edd-b239-003085682f6c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:31:04.802258 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8ea00412-dd3d-4edd-b239-003085682f6c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:31:04.803502 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8ea00412-dd3d-4edd-b239-003085682f6c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1806 microversion: 2.20 time: 0.155307 Jun 16 12:31:04.803948 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 314/619] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:31:04 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1806 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:31:05.822015 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3e0373bf-e130-488e-b63a-01076bf9b081 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:31:05.822620 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3e0373bf-e130-488e-b63a-01076bf9b081 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:31:05.829508 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3e0373bf-e130-488e-b63a-01076bf9b081 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:31:05.829989 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3e0373bf-e130-488e-b63a-01076bf9b081 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:31:05.830747 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3e0373bf-e130-488e-b63a-01076bf9b081 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:31:05.831176 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3e0373bf-e130-488e-b63a-01076bf9b081 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:31:05.962387 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3e0373bf-e130-488e-b63a-01076bf9b081 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:31:05.970839 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3e0373bf-e130-488e-b63a-01076bf9b081 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:31:05.972340 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3e0373bf-e130-488e-b63a-01076bf9b081 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:31:05.973493 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3e0373bf-e130-488e-b63a-01076bf9b081 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1806 microversion: 2.20 time: 0.155361 Jun 16 12:31:05.974077 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 306/620] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:31:05 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1806 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:31:06.992017 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5536bfeb-aeb9-4eb5-bb83-bfacf5ba6167 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:31:06.992635 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5536bfeb-aeb9-4eb5-bb83-bfacf5ba6167 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:31:06.995011 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=62 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:31:07.000290 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5536bfeb-aeb9-4eb5-bb83-bfacf5ba6167 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:31:07.000756 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5536bfeb-aeb9-4eb5-bb83-bfacf5ba6167 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:31:07.001500 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5536bfeb-aeb9-4eb5-bb83-bfacf5ba6167 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:31:07.001959 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5536bfeb-aeb9-4eb5-bb83-bfacf5ba6167 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:31:07.131565 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5536bfeb-aeb9-4eb5-bb83-bfacf5ba6167 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:31:07.141047 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5536bfeb-aeb9-4eb5-bb83-bfacf5ba6167 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:31:07.142599 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5536bfeb-aeb9-4eb5-bb83-bfacf5ba6167 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:31:07.143755 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5536bfeb-aeb9-4eb5-bb83-bfacf5ba6167 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1806 microversion: 2.20 time: 0.155600 Jun 16 12:31:07.144319 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 315/621] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:31:06 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1806 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:31:08.162647 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-726a24dc-3478-4a2c-af5c-d9f100dabe94 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:31:08.163264 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-726a24dc-3478-4a2c-af5c-d9f100dabe94 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:31:08.170306 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-726a24dc-3478-4a2c-af5c-d9f100dabe94 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:31:08.170761 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-726a24dc-3478-4a2c-af5c-d9f100dabe94 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:31:08.171526 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-726a24dc-3478-4a2c-af5c-d9f100dabe94 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:31:08.171984 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-726a24dc-3478-4a2c-af5c-d9f100dabe94 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:31:08.300927 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-726a24dc-3478-4a2c-af5c-d9f100dabe94 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:31:08.309271 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-726a24dc-3478-4a2c-af5c-d9f100dabe94 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:31:08.310802 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-726a24dc-3478-4a2c-af5c-d9f100dabe94 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:31:08.311959 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-726a24dc-3478-4a2c-af5c-d9f100dabe94 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1806 microversion: 2.20 time: 0.153230 Jun 16 12:31:08.312521 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 307/622] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:31:08 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1806 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:31:09.331075 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4239c2f3-dfc7-495b-9e2f-a31267a194c8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:31:09.331616 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4239c2f3-dfc7-495b-9e2f-a31267a194c8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:31:09.337802 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4239c2f3-dfc7-495b-9e2f-a31267a194c8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:31:09.338275 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4239c2f3-dfc7-495b-9e2f-a31267a194c8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:31:09.339039 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4239c2f3-dfc7-495b-9e2f-a31267a194c8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:31:09.339648 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4239c2f3-dfc7-495b-9e2f-a31267a194c8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:31:09.474242 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4239c2f3-dfc7-495b-9e2f-a31267a194c8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:31:09.483225 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4239c2f3-dfc7-495b-9e2f-a31267a194c8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:31:09.484733 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4239c2f3-dfc7-495b-9e2f-a31267a194c8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:31:09.485908 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4239c2f3-dfc7-495b-9e2f-a31267a194c8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1806 microversion: 2.20 time: 0.158892 Jun 16 12:31:09.486460 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 316/623] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:31:09 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1806 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 12:31:10.505364 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d978fb3c-e380-4c2d-b70b-4ad476540e6e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:31:10.506109 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d978fb3c-e380-4c2d-b70b-4ad476540e6e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:31:10.513336 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d978fb3c-e380-4c2d-b70b-4ad476540e6e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:31:10.513782 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d978fb3c-e380-4c2d-b70b-4ad476540e6e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:31:10.514585 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d978fb3c-e380-4c2d-b70b-4ad476540e6e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:31:10.515025 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d978fb3c-e380-4c2d-b70b-4ad476540e6e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:31:10.647843 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d978fb3c-e380-4c2d-b70b-4ad476540e6e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:31:10.657839 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d978fb3c-e380-4c2d-b70b-4ad476540e6e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:31:10.659472 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d978fb3c-e380-4c2d-b70b-4ad476540e6e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:31:10.660875 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d978fb3c-e380-4c2d-b70b-4ad476540e6e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1806 microversion: 2.20 time: 0.160097 Jun 16 12:31:10.661442 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 308/624] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:31:10 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1806 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:31:11.679230 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a2d047cd-2767-41cf-a60e-04aca6eff033 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:31:11.680115 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a2d047cd-2767-41cf-a60e-04aca6eff033 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:31:11.687897 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a2d047cd-2767-41cf-a60e-04aca6eff033 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:31:11.688347 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a2d047cd-2767-41cf-a60e-04aca6eff033 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:31:11.689120 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a2d047cd-2767-41cf-a60e-04aca6eff033 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:31:11.689560 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a2d047cd-2767-41cf-a60e-04aca6eff033 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:31:11.823310 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a2d047cd-2767-41cf-a60e-04aca6eff033 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:31:11.832124 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a2d047cd-2767-41cf-a60e-04aca6eff033 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:31:11.833626 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a2d047cd-2767-41cf-a60e-04aca6eff033 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:31:11.834816 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a2d047cd-2767-41cf-a60e-04aca6eff033 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1806 microversion: 2.20 time: 0.159881 Jun 16 12:31:11.835374 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 317/625] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:31:11 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1806 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:31:12.365545 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-ae852bc9-98f7-45ff-afd5-a21c24becedf req-6a2689bb-7943-45de-a618-435ec8ad45bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8528919e-1e7a-4807-9b11-ae225e65d4df", "name": "network-vif-plugged", "status": "completed", "tag": "ee66a439-1483-44c8-a66e-9b4920bb00e9"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:31:12.377462 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-ae852bc9-98f7-45ff-afd5-a21c24becedf req-6a2689bb-7943-45de-a618-435ec8ad45bf service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:31:12.378510 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-ae852bc9-98f7-45ff-afd5-a21c24becedf req-6a2689bb-7943-45de-a618-435ec8ad45bf service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:31:12.397020 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-ae852bc9-98f7-45ff-afd5-a21c24becedf req-6a2689bb-7943-45de-a618-435ec8ad45bf service nova] Creating event network-vif-plugged:ee66a439-1483-44c8-a66e-9b4920bb00e9 for instance 8528919e-1e7a-4807-9b11-ae225e65d4df on hv-cinder-84614 Jun 16 12:31:12.402600 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-ae852bc9-98f7-45ff-afd5-a21c24becedf req-6a2689bb-7943-45de-a618-435ec8ad45bf service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040873 Jun 16 12:31:12.403329 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 309/626] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:31:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:31:12.853056 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e8336235-5df3-4f06-959f-d14e23e5ecdf tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:31:12.853597 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e8336235-5df3-4f06-959f-d14e23e5ecdf tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:31:12.860772 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e8336235-5df3-4f06-959f-d14e23e5ecdf tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:31:12.861220 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e8336235-5df3-4f06-959f-d14e23e5ecdf tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:31:12.862004 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e8336235-5df3-4f06-959f-d14e23e5ecdf tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:31:12.862448 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e8336235-5df3-4f06-959f-d14e23e5ecdf tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:31:12.991127 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e8336235-5df3-4f06-959f-d14e23e5ecdf tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:31:12.999728 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e8336235-5df3-4f06-959f-d14e23e5ecdf tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:31:13.001802 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e8336235-5df3-4f06-959f-d14e23e5ecdf tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:31:13.002984 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e8336235-5df3-4f06-959f-d14e23e5ecdf tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1806 microversion: 2.20 time: 0.153892 Jun 16 12:31:13.003550 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 318/627] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:31:12 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1806 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:31:14.023670 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9a7d451b-8e8a-4949-8727-915c79b8cd8e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:31:14.024359 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9a7d451b-8e8a-4949-8727-915c79b8cd8e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:31:14.026270 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=42 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:31:14.032332 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9a7d451b-8e8a-4949-8727-915c79b8cd8e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:31:14.033027 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9a7d451b-8e8a-4949-8727-915c79b8cd8e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:31:14.033778 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9a7d451b-8e8a-4949-8727-915c79b8cd8e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:31:14.034242 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9a7d451b-8e8a-4949-8727-915c79b8cd8e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:31:14.164045 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9a7d451b-8e8a-4949-8727-915c79b8cd8e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:31:14.172979 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9a7d451b-8e8a-4949-8727-915c79b8cd8e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:31:14.174540 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9a7d451b-8e8a-4949-8727-915c79b8cd8e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:31:14.175705 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9a7d451b-8e8a-4949-8727-915c79b8cd8e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1806 microversion: 2.20 time: 0.156816 Jun 16 12:31:14.176274 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 310/628] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:31:14 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1806 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:31:15.194298 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-18455b5b-5927-400c-aabe-c1c5001d3b33 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:31:15.194900 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-18455b5b-5927-400c-aabe-c1c5001d3b33 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:31:15.201332 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-18455b5b-5927-400c-aabe-c1c5001d3b33 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:31:15.201877 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-18455b5b-5927-400c-aabe-c1c5001d3b33 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:31:15.202783 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-18455b5b-5927-400c-aabe-c1c5001d3b33 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:31:15.203254 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-18455b5b-5927-400c-aabe-c1c5001d3b33 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:31:15.333465 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-18455b5b-5927-400c-aabe-c1c5001d3b33 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:31:15.342141 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-18455b5b-5927-400c-aabe-c1c5001d3b33 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:31:15.343706 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-18455b5b-5927-400c-aabe-c1c5001d3b33 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:31:15.345124 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-18455b5b-5927-400c-aabe-c1c5001d3b33 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1806 microversion: 2.20 time: 0.154751 Jun 16 12:31:15.345682 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 319/629] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:31:15 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1806 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:31:16.363645 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d930e5cd-ad3f-4147-89f5-3691f003fe3d tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:31:16.364254 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d930e5cd-ad3f-4147-89f5-3691f003fe3d tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:31:16.370782 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d930e5cd-ad3f-4147-89f5-3691f003fe3d tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:31:16.371224 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d930e5cd-ad3f-4147-89f5-3691f003fe3d tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:31:16.371976 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d930e5cd-ad3f-4147-89f5-3691f003fe3d tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:31:16.372408 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d930e5cd-ad3f-4147-89f5-3691f003fe3d tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:31:16.505607 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d930e5cd-ad3f-4147-89f5-3691f003fe3d tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:31:16.514215 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d930e5cd-ad3f-4147-89f5-3691f003fe3d tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:31:16.516291 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d930e5cd-ad3f-4147-89f5-3691f003fe3d tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:31:16.517483 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d930e5cd-ad3f-4147-89f5-3691f003fe3d tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1806 microversion: 2.20 time: 0.158257 Jun 16 12:31:16.518060 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 311/630] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:31:16 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1806 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:31:17.536622 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e4e68fef-d489-492c-9661-58e5b11cbbc7 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:31:17.537233 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e4e68fef-d489-492c-9661-58e5b11cbbc7 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:31:17.543758 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e4e68fef-d489-492c-9661-58e5b11cbbc7 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:31:17.544202 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e4e68fef-d489-492c-9661-58e5b11cbbc7 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:31:17.544954 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e4e68fef-d489-492c-9661-58e5b11cbbc7 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:31:17.545382 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e4e68fef-d489-492c-9661-58e5b11cbbc7 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:31:17.673185 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e4e68fef-d489-492c-9661-58e5b11cbbc7 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:31:17.681458 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e4e68fef-d489-492c-9661-58e5b11cbbc7 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:31:17.683002 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e4e68fef-d489-492c-9661-58e5b11cbbc7 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:31:17.684152 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e4e68fef-d489-492c-9661-58e5b11cbbc7 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1806 microversion: 2.20 time: 0.152725 Jun 16 12:31:17.684713 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 320/631] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:31:17 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1806 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:31:18.702047 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-86bcfba6-4f71-41d2-8251-6df00899aef5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:31:18.702653 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-86bcfba6-4f71-41d2-8251-6df00899aef5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:31:18.710425 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-86bcfba6-4f71-41d2-8251-6df00899aef5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:31:18.710876 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-86bcfba6-4f71-41d2-8251-6df00899aef5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:31:18.711637 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-86bcfba6-4f71-41d2-8251-6df00899aef5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:31:18.712071 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-86bcfba6-4f71-41d2-8251-6df00899aef5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:31:18.843131 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-86bcfba6-4f71-41d2-8251-6df00899aef5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:31:18.852132 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-86bcfba6-4f71-41d2-8251-6df00899aef5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:31:18.853634 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-86bcfba6-4f71-41d2-8251-6df00899aef5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:31:18.854841 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-86bcfba6-4f71-41d2-8251-6df00899aef5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1806 microversion: 2.20 time: 0.156682 Jun 16 12:31:18.855433 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 312/632] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:31:18 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1806 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:31:19.675510 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-edb8a602-658a-4051-952b-a91e51565c82 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1758782139", "imageRef": "c736a2d2-9d0d-41ec-b9fc-971428b0ff7a", "flavorRef": "452", "networks": [{"uuid": "a714d974-7de3-44a6-a856-0298637e4d4a"}]}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:31:19.726735 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.network.neutron [None req-edb8a602-658a-4051-952b-a91e51565c82 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] validate_networks() for [('a714d974-7de3-44a6-a856-0298637e4d4a', None, None, None, None, None)] {{(pid=117607) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 12:31:19.873717 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-59f31bd0-455d-4ca4-8333-28adefeec8e8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:31:19.874519 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-59f31bd0-455d-4ca4-8333-28adefeec8e8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:31:19.882435 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-59f31bd0-455d-4ca4-8333-28adefeec8e8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:31:19.882888 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-59f31bd0-455d-4ca4-8333-28adefeec8e8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:31:19.883740 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-59f31bd0-455d-4ca4-8333-28adefeec8e8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:31:19.884082 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-59f31bd0-455d-4ca4-8333-28adefeec8e8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:31:20.085478 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-59f31bd0-455d-4ca4-8333-28adefeec8e8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:31:20.094833 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-59f31bd0-455d-4ca4-8333-28adefeec8e8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:31:20.096524 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-59f31bd0-455d-4ca4-8333-28adefeec8e8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:31:20.097761 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-59f31bd0-455d-4ca4-8333-28adefeec8e8 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1806 microversion: 2.20 time: 0.227883 Jun 16 12:31:20.098305 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 313/633] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:31:19 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1806 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 12:31:20.149967 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-edb8a602-658a-4051-952b-a91e51565c82 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Flavor limits 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 12:31:20.150480 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-edb8a602-658a-4051-952b-a91e51565c82 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Image limits 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 12:31:20.151018 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-edb8a602-658a-4051-952b-a91e51565c82 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Flavor pref 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 12:31:20.151467 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-edb8a602-658a-4051-952b-a91e51565c82 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Image pref 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 12:31:20.151907 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-edb8a602-658a-4051-952b-a91e51565c82 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 12:31:20.162046 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-edb8a602-658a-4051-952b-a91e51565c82 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:31:20.162677 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-edb8a602-658a-4051-952b-a91e51565c82 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:31:20.163536 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-edb8a602-658a-4051-952b-a91e51565c82 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:31:20.164036 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-edb8a602-658a-4051-952b-a91e51565c82 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:31:20.182628 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-edb8a602-658a-4051-952b-a91e51565c82 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Getting quotas for project b09e491f80c24a2691e396df0175a057. Resources: {'instances', 'cores', 'ram'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 12:31:20.186745 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-edb8a602-658a-4051-952b-a91e51565c82 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Getting quotas for user b5f451e0f5c945d8ade3c2a4ea3398c2 and project b09e491f80c24a2691e396df0175a057. Resources: {'instances', 'cores', 'ram'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 12:31:20.197964 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-edb8a602-658a-4051-952b-a91e51565c82 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Going to run 1 instances... {{(pid=117607) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 12:31:20.200394 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-edb8a602-658a-4051-952b-a91e51565c82 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] [instance: 3c592360-3de6-4be0-9c5e-c0bbd8008a46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c736a2d2-9d0d-41ec-b9fc-971428b0ff7a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117607) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 12:31:20.248581 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-edb8a602-658a-4051-952b-a91e51565c82 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.577060 Jun 16 12:31:20.249201 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 321/634] 10.222.0.45 () {60 vars in 1146 bytes} [Thu Jun 16 12:31:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 12:31:20.263523 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7ffbf339-eed4-4b9a-9d66-1b2816566d24 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:31:20.264827 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7ffbf339-eed4-4b9a-9d66-1b2816566d24 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] [instance: 3c592360-3de6-4be0-9c5e-c0bbd8008a46] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:31:20.332714 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7ffbf339-eed4-4b9a-9d66-1b2816566d24 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f451e0f5c945d8ade3c2a4ea3398c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09e491f80c24a2691e396df0175a057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:31:20.344637 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7ffbf339-eed4-4b9a-9d66-1b2816566d24 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] 10.222.0.45 "GET /compute/v2.1/servers/3c592360-3de6-4be0-9c5e-c0bbd8008a46" status: 200 len: 1219 microversion: 2.1 time: 0.087795 Jun 16 12:31:20.346437 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 314/635] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:31:20 2022] GET /compute/v2.1/servers/3c592360-3de6-4be0-9c5e-c0bbd8008a46 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:31:21.116249 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e5906b75-eab5-469a-a79d-a9d08d564f1e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:31:21.116866 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e5906b75-eab5-469a-a79d-a9d08d564f1e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:31:21.123606 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e5906b75-eab5-469a-a79d-a9d08d564f1e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:31:21.124062 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e5906b75-eab5-469a-a79d-a9d08d564f1e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:31:21.124828 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e5906b75-eab5-469a-a79d-a9d08d564f1e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:31:21.125270 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e5906b75-eab5-469a-a79d-a9d08d564f1e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:31:21.260893 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e5906b75-eab5-469a-a79d-a9d08d564f1e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:31:21.269498 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e5906b75-eab5-469a-a79d-a9d08d564f1e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:31:21.271052 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e5906b75-eab5-469a-a79d-a9d08d564f1e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:31:21.272213 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e5906b75-eab5-469a-a79d-a9d08d564f1e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1793 microversion: 2.20 time: 0.160456 Jun 16 12:31:21.272772 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 322/636] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:31:21 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1793 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:31:21.376458 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-352f9f21-20bf-4484-9b48-456b1b3dcde1 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:31:21.379614 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-352f9f21-20bf-4484-9b48-456b1b3dcde1 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] [instance: 3c592360-3de6-4be0-9c5e-c0bbd8008a46] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:31:21.392216 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-352f9f21-20bf-4484-9b48-456b1b3dcde1 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:31:21.393129 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-352f9f21-20bf-4484-9b48-456b1b3dcde1 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:31:21.394602 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-352f9f21-20bf-4484-9b48-456b1b3dcde1 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:31:21.395623 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-352f9f21-20bf-4484-9b48-456b1b3dcde1 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:31:21.477198 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-352f9f21-20bf-4484-9b48-456b1b3dcde1 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f451e0f5c945d8ade3c2a4ea3398c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09e491f80c24a2691e396df0175a057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:31:21.485619 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-352f9f21-20bf-4484-9b48-456b1b3dcde1 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] 10.222.0.45 "GET /compute/v2.1/servers/3c592360-3de6-4be0-9c5e-c0bbd8008a46" status: 200 len: 1279 microversion: 2.1 time: 0.121042 Jun 16 12:31:21.487153 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 315/637] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:31:21 2022] GET /compute/v2.1/servers/3c592360-3de6-4be0-9c5e-c0bbd8008a46 => generated 1279 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:31:22.504422 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-77a04f80-ed21-4699-b8bf-de79961f0014 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:31:22.505042 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-77a04f80-ed21-4699-b8bf-de79961f0014 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] [instance: 3c592360-3de6-4be0-9c5e-c0bbd8008a46] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:31:22.512234 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-77a04f80-ed21-4699-b8bf-de79961f0014 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:31:22.512685 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-77a04f80-ed21-4699-b8bf-de79961f0014 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:31:22.513456 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-77a04f80-ed21-4699-b8bf-de79961f0014 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:31:22.513906 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-77a04f80-ed21-4699-b8bf-de79961f0014 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:31:22.734179 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-77a04f80-ed21-4699-b8bf-de79961f0014 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f451e0f5c945d8ade3c2a4ea3398c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09e491f80c24a2691e396df0175a057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:31:22.741626 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-77a04f80-ed21-4699-b8bf-de79961f0014 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] 10.222.0.45 "GET /compute/v2.1/servers/3c592360-3de6-4be0-9c5e-c0bbd8008a46" status: 200 len: 1319 microversion: 2.1 time: 0.241988 Jun 16 12:31:22.742226 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 323/638] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:31:22 2022] GET /compute/v2.1/servers/3c592360-3de6-4be0-9c5e-c0bbd8008a46 => generated 1319 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:31:23.013564 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-a3d4aeb8-94b9-4dc0-ba7c-1fd8362f95f3 req-cef206db-a9f2-48c0-b55a-e9ceb4e22598 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c592360-3de6-4be0-9c5e-c0bbd8008a46", "tag": "41e3908c-a37d-4fd0-926c-d38348c9c351"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:31:23.022636 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-a3d4aeb8-94b9-4dc0-ba7c-1fd8362f95f3 req-cef206db-a9f2-48c0-b55a-e9ceb4e22598 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:31:23.023359 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-a3d4aeb8-94b9-4dc0-ba7c-1fd8362f95f3 req-cef206db-a9f2-48c0-b55a-e9ceb4e22598 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:31:23.035190 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-a3d4aeb8-94b9-4dc0-ba7c-1fd8362f95f3 req-cef206db-a9f2-48c0-b55a-e9ceb4e22598 service nova] Creating event network-changed:41e3908c-a37d-4fd0-926c-d38348c9c351 for instance 3c592360-3de6-4be0-9c5e-c0bbd8008a46 on hv-cinder-84614 Jun 16 12:31:23.040501 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-a3d4aeb8-94b9-4dc0-ba7c-1fd8362f95f3 req-cef206db-a9f2-48c0-b55a-e9ceb4e22598 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030066 Jun 16 12:31:23.040700 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 316/639] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:31:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:31:23.757997 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-cc04f442-1d7b-452c-9078-2fc9efca38c6 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:31:23.758521 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-cc04f442-1d7b-452c-9078-2fc9efca38c6 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] [instance: 3c592360-3de6-4be0-9c5e-c0bbd8008a46] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:31:23.765093 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cc04f442-1d7b-452c-9078-2fc9efca38c6 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:31:23.765545 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cc04f442-1d7b-452c-9078-2fc9efca38c6 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:31:23.767056 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cc04f442-1d7b-452c-9078-2fc9efca38c6 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:31:23.767492 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cc04f442-1d7b-452c-9078-2fc9efca38c6 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:31:23.896630 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-cc04f442-1d7b-452c-9078-2fc9efca38c6 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f451e0f5c945d8ade3c2a4ea3398c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09e491f80c24a2691e396df0175a057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:31:23.903907 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-cc04f442-1d7b-452c-9078-2fc9efca38c6 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] 10.222.0.45 "GET /compute/v2.1/servers/3c592360-3de6-4be0-9c5e-c0bbd8008a46" status: 200 len: 1319 microversion: 2.1 time: 0.149883 Jun 16 12:31:23.904448 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 324/640] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:31:23 2022] GET /compute/v2.1/servers/3c592360-3de6-4be0-9c5e-c0bbd8008a46 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:31:24.921891 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2ded3abd-2f5f-4940-91e0-449ff8299207 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:31:24.923160 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2ded3abd-2f5f-4940-91e0-449ff8299207 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] [instance: 3c592360-3de6-4be0-9c5e-c0bbd8008a46] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:31:24.929404 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2ded3abd-2f5f-4940-91e0-449ff8299207 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:31:24.929858 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2ded3abd-2f5f-4940-91e0-449ff8299207 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:31:24.930645 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2ded3abd-2f5f-4940-91e0-449ff8299207 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:31:24.931084 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2ded3abd-2f5f-4940-91e0-449ff8299207 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:31:25.059437 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2ded3abd-2f5f-4940-91e0-449ff8299207 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f451e0f5c945d8ade3c2a4ea3398c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09e491f80c24a2691e396df0175a057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:31:25.067333 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2ded3abd-2f5f-4940-91e0-449ff8299207 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] 10.222.0.45 "GET /compute/v2.1/servers/3c592360-3de6-4be0-9c5e-c0bbd8008a46" status: 200 len: 1319 microversion: 2.1 time: 0.150186 Jun 16 12:31:25.067889 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 317/641] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:31:24 2022] GET /compute/v2.1/servers/3c592360-3de6-4be0-9c5e-c0bbd8008a46 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:31:26.084477 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-959308b7-6cad-44db-9a42-0b4c07b08dd4 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:31:26.085097 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-959308b7-6cad-44db-9a42-0b4c07b08dd4 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] [instance: 3c592360-3de6-4be0-9c5e-c0bbd8008a46] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:31:26.091710 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-959308b7-6cad-44db-9a42-0b4c07b08dd4 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:31:26.092162 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-959308b7-6cad-44db-9a42-0b4c07b08dd4 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:31:26.092925 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-959308b7-6cad-44db-9a42-0b4c07b08dd4 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:31:26.093363 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-959308b7-6cad-44db-9a42-0b4c07b08dd4 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:31:26.220947 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-959308b7-6cad-44db-9a42-0b4c07b08dd4 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f451e0f5c945d8ade3c2a4ea3398c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09e491f80c24a2691e396df0175a057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:31:26.228192 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-959308b7-6cad-44db-9a42-0b4c07b08dd4 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] 10.222.0.45 "GET /compute/v2.1/servers/3c592360-3de6-4be0-9c5e-c0bbd8008a46" status: 200 len: 1319 microversion: 2.1 time: 0.147621 Jun 16 12:31:26.228748 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 325/642] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:31:26 2022] GET /compute/v2.1/servers/3c592360-3de6-4be0-9c5e-c0bbd8008a46 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:31:27.245850 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-658bf15d-f461-44dd-b2c0-c0a8bea08c6a tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:31:27.246522 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-658bf15d-f461-44dd-b2c0-c0a8bea08c6a tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] [instance: 3c592360-3de6-4be0-9c5e-c0bbd8008a46] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:31:27.253139 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-658bf15d-f461-44dd-b2c0-c0a8bea08c6a tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:31:27.253586 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-658bf15d-f461-44dd-b2c0-c0a8bea08c6a tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:31:27.254392 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-658bf15d-f461-44dd-b2c0-c0a8bea08c6a tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:31:27.254824 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-658bf15d-f461-44dd-b2c0-c0a8bea08c6a tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:31:27.385885 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-658bf15d-f461-44dd-b2c0-c0a8bea08c6a tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f451e0f5c945d8ade3c2a4ea3398c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09e491f80c24a2691e396df0175a057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:31:27.393389 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-658bf15d-f461-44dd-b2c0-c0a8bea08c6a tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] 10.222.0.45 "GET /compute/v2.1/servers/3c592360-3de6-4be0-9c5e-c0bbd8008a46" status: 200 len: 1319 microversion: 2.1 time: 0.151561 Jun 16 12:31:27.394027 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 318/643] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:31:27 2022] GET /compute/v2.1/servers/3c592360-3de6-4be0-9c5e-c0bbd8008a46 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:31:28.416361 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f887d439-7911-491a-b0fb-8c59ed0b7ec7 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:31:28.417271 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f887d439-7911-491a-b0fb-8c59ed0b7ec7 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] [instance: 3c592360-3de6-4be0-9c5e-c0bbd8008a46] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:31:28.426204 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f887d439-7911-491a-b0fb-8c59ed0b7ec7 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:31:28.427603 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f887d439-7911-491a-b0fb-8c59ed0b7ec7 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:31:28.428991 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f887d439-7911-491a-b0fb-8c59ed0b7ec7 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:31:28.429815 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f887d439-7911-491a-b0fb-8c59ed0b7ec7 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:31:28.567801 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f887d439-7911-491a-b0fb-8c59ed0b7ec7 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f451e0f5c945d8ade3c2a4ea3398c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09e491f80c24a2691e396df0175a057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:31:28.569969 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:31:28.576596 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f887d439-7911-491a-b0fb-8c59ed0b7ec7 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] 10.222.0.45 "GET /compute/v2.1/servers/3c592360-3de6-4be0-9c5e-c0bbd8008a46" status: 200 len: 1319 microversion: 2.1 time: 0.166318 Jun 16 12:31:28.577167 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 326/644] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:31:28 2022] GET /compute/v2.1/servers/3c592360-3de6-4be0-9c5e-c0bbd8008a46 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:31:29.593328 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-48d42f9b-3598-4d52-b6e0-651a5ed93b2d tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:31:29.593974 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-48d42f9b-3598-4d52-b6e0-651a5ed93b2d tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] [instance: 3c592360-3de6-4be0-9c5e-c0bbd8008a46] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:31:29.600519 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-48d42f9b-3598-4d52-b6e0-651a5ed93b2d tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:31:29.600965 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-48d42f9b-3598-4d52-b6e0-651a5ed93b2d tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:31:29.601749 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-48d42f9b-3598-4d52-b6e0-651a5ed93b2d tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:31:29.602206 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-48d42f9b-3598-4d52-b6e0-651a5ed93b2d tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:31:29.604778 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=97 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:31:29.735081 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-48d42f9b-3598-4d52-b6e0-651a5ed93b2d tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f451e0f5c945d8ade3c2a4ea3398c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09e491f80c24a2691e396df0175a057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:31:29.742487 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-48d42f9b-3598-4d52-b6e0-651a5ed93b2d tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] 10.222.0.45 "GET /compute/v2.1/servers/3c592360-3de6-4be0-9c5e-c0bbd8008a46" status: 200 len: 1319 microversion: 2.1 time: 0.153039 Jun 16 12:31:29.743046 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 319/645] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:31:29 2022] GET /compute/v2.1/servers/3c592360-3de6-4be0-9c5e-c0bbd8008a46 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:31:30.630386 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-170b6e68-f445-4553-b31e-59314b5edbfa req-e4a3b491-1313-4a60-9c9c-dc1099bd6237 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c592360-3de6-4be0-9c5e-c0bbd8008a46", "name": "network-vif-plugged", "status": "completed", "tag": "41e3908c-a37d-4fd0-926c-d38348c9c351"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:31:30.638633 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell0:SELECT=2 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:31:30.639862 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell0:SELECT=6 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:31:30.648087 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-170b6e68-f445-4553-b31e-59314b5edbfa req-e4a3b491-1313-4a60-9c9c-dc1099bd6237 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:31:30.648887 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-170b6e68-f445-4553-b31e-59314b5edbfa req-e4a3b491-1313-4a60-9c9c-dc1099bd6237 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:31:30.662093 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-170b6e68-f445-4553-b31e-59314b5edbfa req-e4a3b491-1313-4a60-9c9c-dc1099bd6237 service nova] Creating event network-vif-plugged:41e3908c-a37d-4fd0-926c-d38348c9c351 for instance 3c592360-3de6-4be0-9c5e-c0bbd8008a46 on hv-cinder-84614 Jun 16 12:31:30.668153 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-170b6e68-f445-4553-b31e-59314b5edbfa req-e4a3b491-1313-4a60-9c9c-dc1099bd6237 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042047 Jun 16 12:31:30.669104 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 327/646] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:31:30.759559 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a5a35d4b-92f0-4093-b065-2380323d3082 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:31:30.760190 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a5a35d4b-92f0-4093-b065-2380323d3082 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] [instance: 3c592360-3de6-4be0-9c5e-c0bbd8008a46] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:31:30.762239 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=2 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:31:30.768264 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a5a35d4b-92f0-4093-b065-2380323d3082 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:31:30.768719 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a5a35d4b-92f0-4093-b065-2380323d3082 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:31:30.769498 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a5a35d4b-92f0-4093-b065-2380323d3082 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:31:30.769980 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a5a35d4b-92f0-4093-b065-2380323d3082 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:31:30.962286 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a5a35d4b-92f0-4093-b065-2380323d3082 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f451e0f5c945d8ade3c2a4ea3398c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09e491f80c24a2691e396df0175a057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:31:30.969615 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a5a35d4b-92f0-4093-b065-2380323d3082 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] 10.222.0.45 "GET /compute/v2.1/servers/3c592360-3de6-4be0-9c5e-c0bbd8008a46" status: 200 len: 1319 microversion: 2.1 time: 0.214249 Jun 16 12:31:30.970219 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 320/647] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:31:30 2022] GET /compute/v2.1/servers/3c592360-3de6-4be0-9c5e-c0bbd8008a46 => generated 1319 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:31:31.988248 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5d51cf38-417f-4644-9702-7775706d1591 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:31:31.988894 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5d51cf38-417f-4644-9702-7775706d1591 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] [instance: 3c592360-3de6-4be0-9c5e-c0bbd8008a46] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:31:31.995236 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5d51cf38-417f-4644-9702-7775706d1591 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:31:31.995986 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5d51cf38-417f-4644-9702-7775706d1591 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:31:31.996754 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5d51cf38-417f-4644-9702-7775706d1591 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:31:31.997195 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5d51cf38-417f-4644-9702-7775706d1591 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:31:32.145563 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5d51cf38-417f-4644-9702-7775706d1591 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f451e0f5c945d8ade3c2a4ea3398c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09e491f80c24a2691e396df0175a057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:31:32.152890 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5d51cf38-417f-4644-9702-7775706d1591 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] 10.222.0.45 "GET /compute/v2.1/servers/3c592360-3de6-4be0-9c5e-c0bbd8008a46" status: 200 len: 1319 microversion: 2.1 time: 0.169378 Jun 16 12:31:32.153447 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 328/648] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:31:31 2022] GET /compute/v2.1/servers/3c592360-3de6-4be0-9c5e-c0bbd8008a46 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:31:33.171094 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-db536b37-6757-4d8d-924f-6f96f42ad37c tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:31:33.171697 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-db536b37-6757-4d8d-924f-6f96f42ad37c tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] [instance: 3c592360-3de6-4be0-9c5e-c0bbd8008a46] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:31:33.179363 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-db536b37-6757-4d8d-924f-6f96f42ad37c tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:31:33.179857 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-db536b37-6757-4d8d-924f-6f96f42ad37c tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:31:33.180621 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-db536b37-6757-4d8d-924f-6f96f42ad37c tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:31:33.181051 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-db536b37-6757-4d8d-924f-6f96f42ad37c tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:31:33.485462 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-db536b37-6757-4d8d-924f-6f96f42ad37c tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f451e0f5c945d8ade3c2a4ea3398c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09e491f80c24a2691e396df0175a057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:31:33.493463 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-db536b37-6757-4d8d-924f-6f96f42ad37c tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] 10.222.0.45 "GET /compute/v2.1/servers/3c592360-3de6-4be0-9c5e-c0bbd8008a46" status: 200 len: 1508 microversion: 2.1 time: 0.326200 Jun 16 12:31:33.494053 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 321/649] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:31:33 2022] GET /compute/v2.1/servers/3c592360-3de6-4be0-9c5e-c0bbd8008a46 => generated 1508 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:31:33.510049 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1c33fe9f-7700-41a5-b733-abc0008b4aed tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1f3cbc71-3ee0-4db3-91ea-01f764a04434", "device": "/dev/sdb"}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:31:33.511603 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1c33fe9f-7700-41a5-b733-abc0008b4aed tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] [instance: 3c592360-3de6-4be0-9c5e-c0bbd8008a46] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:31:33.517967 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1c33fe9f-7700-41a5-b733-abc0008b4aed tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:31:33.518414 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1c33fe9f-7700-41a5-b733-abc0008b4aed tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:31:33.519167 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1c33fe9f-7700-41a5-b733-abc0008b4aed tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:31:33.519598 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1c33fe9f-7700-41a5-b733-abc0008b4aed tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:31:33.762514 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1c33fe9f-7700-41a5-b733-abc0008b4aed tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] 10.222.0.45 "POST /compute/v2.1/servers/3c592360-3de6-4be0-9c5e-c0bbd8008a46/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.256162 Jun 16 12:31:33.763122 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 329/650] 10.222.0.45 () {60 vars in 1322 bytes} [Thu Jun 16 12:31:33 2022] POST /compute/v2.1/servers/3c592360-3de6-4be0-9c5e-c0bbd8008a46/os-volume_attachments => generated 194 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:32:12.983410 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ce0315d6-f604-40f9-95ad-697f10cf1855 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:32:12.983919 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ce0315d6-f604-40f9-95ad-697f10cf1855 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] [instance: 3c592360-3de6-4be0-9c5e-c0bbd8008a46] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:32:12.986082 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=25 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:32:12.986728 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=17 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:32:12.992830 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ce0315d6-f604-40f9-95ad-697f10cf1855 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:12.993803 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ce0315d6-f604-40f9-95ad-697f10cf1855 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:12.994669 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ce0315d6-f604-40f9-95ad-697f10cf1855 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:12.995107 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ce0315d6-f604-40f9-95ad-697f10cf1855 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:13.119404 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.objects.instance [None req-ce0315d6-f604-40f9-95ad-697f10cf1855 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lazy-loading 'services' on Instance uuid 3c592360-3de6-4be0-9c5e-c0bbd8008a46 {{(pid=117606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 12:32:13.231646 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ce0315d6-f604-40f9-95ad-697f10cf1855 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] 10.222.0.45 "DELETE /compute/v2.1/servers/3c592360-3de6-4be0-9c5e-c0bbd8008a46/os-volume_attachments/1f3cbc71-3ee0-4db3-91ea-01f764a04434" status: 202 len: 0 microversion: 2.1 time: 0.251889 Jun 16 12:32:13.232336 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 322/651] 10.222.0.45 () {58 vars in 1415 bytes} [Thu Jun 16 12:32:12 2022] DELETE /compute/v2.1/servers/3c592360-3de6-4be0-9c5e-c0bbd8008a46/os-volume_attachments/1f3cbc71-3ee0-4db3-91ea-01f764a04434 => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 12:32:14.360591 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:32:14.361895 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=20,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:32:14.366592 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-be672050-1bd7-4345-8e7f-4c6a350cdaa7 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:32:14.367188 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-be672050-1bd7-4345-8e7f-4c6a350cdaa7 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] [instance: 3c592360-3de6-4be0-9c5e-c0bbd8008a46] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:32:14.376322 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-be672050-1bd7-4345-8e7f-4c6a350cdaa7 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:14.376853 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-be672050-1bd7-4345-8e7f-4c6a350cdaa7 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:14.377699 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-be672050-1bd7-4345-8e7f-4c6a350cdaa7 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:14.378174 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-be672050-1bd7-4345-8e7f-4c6a350cdaa7 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:14.406294 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-be672050-1bd7-4345-8e7f-4c6a350cdaa7 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] [instance: 3c592360-3de6-4be0-9c5e-c0bbd8008a46] Going to try to terminate instance {{(pid=117607) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 12:32:14.476638 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-be672050-1bd7-4345-8e7f-4c6a350cdaa7 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] 10.222.0.45 "DELETE /compute/v2.1/servers/3c592360-3de6-4be0-9c5e-c0bbd8008a46" status: 204 len: 0 microversion: 2.1 time: 0.117507 Jun 16 12:32:14.477357 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 330/652] 10.222.0.45 () {58 vars in 1238 bytes} [Thu Jun 16 12:32:14 2022] DELETE /compute/v2.1/servers/3c592360-3de6-4be0-9c5e-c0bbd8008a46 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 12:32:14.486649 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ccf5c94c-19e9-42f1-a74f-88ca60a68ed9 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:32:14.487352 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ccf5c94c-19e9-42f1-a74f-88ca60a68ed9 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] [instance: 3c592360-3de6-4be0-9c5e-c0bbd8008a46] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:32:14.494677 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ccf5c94c-19e9-42f1-a74f-88ca60a68ed9 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:14.495127 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ccf5c94c-19e9-42f1-a74f-88ca60a68ed9 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:14.495893 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ccf5c94c-19e9-42f1-a74f-88ca60a68ed9 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:14.496328 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ccf5c94c-19e9-42f1-a74f-88ca60a68ed9 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:14.625474 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ccf5c94c-19e9-42f1-a74f-88ca60a68ed9 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f451e0f5c945d8ade3c2a4ea3398c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09e491f80c24a2691e396df0175a057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:32:14.632815 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ccf5c94c-19e9-42f1-a74f-88ca60a68ed9 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] 10.222.0.45 "GET /compute/v2.1/servers/3c592360-3de6-4be0-9c5e-c0bbd8008a46" status: 200 len: 1514 microversion: 2.1 time: 0.151014 Jun 16 12:32:14.633369 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 323/653] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:32:14 2022] GET /compute/v2.1/servers/3c592360-3de6-4be0-9c5e-c0bbd8008a46 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:32:15.651438 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2175759a-9281-4d72-b151-f983ef120eca tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:32:15.652093 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2175759a-9281-4d72-b151-f983ef120eca tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] [instance: 3c592360-3de6-4be0-9c5e-c0bbd8008a46] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:32:15.658759 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2175759a-9281-4d72-b151-f983ef120eca tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:15.659206 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2175759a-9281-4d72-b151-f983ef120eca tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:15.659964 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2175759a-9281-4d72-b151-f983ef120eca tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:15.660401 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2175759a-9281-4d72-b151-f983ef120eca tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:15.946892 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2175759a-9281-4d72-b151-f983ef120eca tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f451e0f5c945d8ade3c2a4ea3398c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09e491f80c24a2691e396df0175a057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:32:15.954289 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2175759a-9281-4d72-b151-f983ef120eca tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] 10.222.0.45 "GET /compute/v2.1/servers/3c592360-3de6-4be0-9c5e-c0bbd8008a46" status: 200 len: 1514 microversion: 2.1 time: 0.307736 Jun 16 12:32:15.954857 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 331/654] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:32:15 2022] GET /compute/v2.1/servers/3c592360-3de6-4be0-9c5e-c0bbd8008a46 => generated 1514 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:32:16.970873 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3114dc3b-154b-4381-938e-b5e067a6914b tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:32:16.971500 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3114dc3b-154b-4381-938e-b5e067a6914b tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] [instance: 3c592360-3de6-4be0-9c5e-c0bbd8008a46] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:32:16.978426 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3114dc3b-154b-4381-938e-b5e067a6914b tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:16.978880 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3114dc3b-154b-4381-938e-b5e067a6914b tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:16.979669 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3114dc3b-154b-4381-938e-b5e067a6914b tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:16.980104 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3114dc3b-154b-4381-938e-b5e067a6914b tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:17.090096 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3114dc3b-154b-4381-938e-b5e067a6914b tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f451e0f5c945d8ade3c2a4ea3398c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09e491f80c24a2691e396df0175a057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:32:17.097421 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3114dc3b-154b-4381-938e-b5e067a6914b tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] 10.222.0.45 "GET /compute/v2.1/servers/3c592360-3de6-4be0-9c5e-c0bbd8008a46" status: 200 len: 1472 microversion: 2.1 time: 0.130409 Jun 16 12:32:17.098004 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 324/655] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:32:16 2022] GET /compute/v2.1/servers/3c592360-3de6-4be0-9c5e-c0bbd8008a46 => generated 1472 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:32:17.187036 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-db2ad1da-3fb4-4c72-9dd8-ad93e24e5afa req-129b1876-a26c-438c-9017-fd62f7b42f57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c592360-3de6-4be0-9c5e-c0bbd8008a46", "name": "network-vif-deleted", "tag": "41e3908c-a37d-4fd0-926c-d38348c9c351"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:32:17.195195 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-db2ad1da-3fb4-4c72-9dd8-ad93e24e5afa req-129b1876-a26c-438c-9017-fd62f7b42f57 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:17.195740 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-db2ad1da-3fb4-4c72-9dd8-ad93e24e5afa req-129b1876-a26c-438c-9017-fd62f7b42f57 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:17.207719 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-db2ad1da-3fb4-4c72-9dd8-ad93e24e5afa req-129b1876-a26c-438c-9017-fd62f7b42f57 service nova] Creating event network-vif-deleted:41e3908c-a37d-4fd0-926c-d38348c9c351 for instance 3c592360-3de6-4be0-9c5e-c0bbd8008a46 on hv-cinder-84614 Jun 16 12:32:17.212749 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-db2ad1da-3fb4-4c72-9dd8-ad93e24e5afa req-129b1876-a26c-438c-9017-fd62f7b42f57 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092725 Jun 16 12:32:17.213396 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 332/656] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 12:32:18.115003 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-17e2570e-3b3e-405f-bb2a-0962c014fef5 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:32:18.115627 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-17e2570e-3b3e-405f-bb2a-0962c014fef5 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] [instance: 3c592360-3de6-4be0-9c5e-c0bbd8008a46] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:32:18.122252 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-17e2570e-3b3e-405f-bb2a-0962c014fef5 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:18.122700 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-17e2570e-3b3e-405f-bb2a-0962c014fef5 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:18.123472 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-17e2570e-3b3e-405f-bb2a-0962c014fef5 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:18.123909 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-17e2570e-3b3e-405f-bb2a-0962c014fef5 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:18.136738 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-17e2570e-3b3e-405f-bb2a-0962c014fef5 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] HTTP exception thrown: Instance 3c592360-3de6-4be0-9c5e-c0bbd8008a46 could not be found. Jun 16 12:32:18.138381 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-17e2570e-3b3e-405f-bb2a-0962c014fef5 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Request method failure captured: Jun 16 12:32:18.138381 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: request: GET /compute/v2.1/servers/3c592360-3de6-4be0-9c5e-c0bbd8008a46 HTTP/1.1 Jun 16 12:32:18.138381 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 16 12:32:18.138381 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 16 12:32:18.138381 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Connection: close Jun 16 12:32:18.138381 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 16 12:32:18.138381 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 16 12:32:18.138381 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Host: 10.222.0.45 Jun 16 12:32:18.138381 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 16 12:32:18.138381 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 16 12:32:18.138381 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABiqyIJ5HzBoXNVtm1tcKnQsP9BeBPzcsI6z9e0O99bbDVVfnscfWoxVKzm5yn4Sc3L7NPXP7gXdU4K5aIQkvSdgd4mkdE3ksvYZWJgknSpxdgxuY7AZvLBwpS91ycQcJvlMrBrf9J3y2wh4lomIJdrpezT1exHzzfP522ICi-FTqptgLc Jun 16 12:32:18.138381 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 16 12:32:18.138381 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 16 12:32:18.138381 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 16 12:32:18.138381 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 16 12:32:18.138381 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 16 12:32:18.138381 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 16 12:32:18.138381 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Id: b09e491f80c24a2691e396df0175a057 Jun 16 12:32:18.138381 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1226929550 Jun 16 12:32:18.138381 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 16 12:32:18.138381 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 16 12:32:18.139929 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/b09e491f80c24a2691e396df0175a057"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b09e491f80c24a2691e396df0175a057"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_b09e491f80c24a2691e396df0175a057"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b09e491f80c24a2691e396df0175a057"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Jun 16 12:32:18.139929 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-VolumesSnapshotTestJSON-1226929550 Jun 16 12:32:18.139929 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant-Id: b09e491f80c24a2691e396df0175a057 Jun 16 12:32:18.139929 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1226929550 Jun 16 12:32:18.139929 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User: tempest-VolumesSnapshotTestJSON-1226929550-project Jun 16 12:32:18.139929 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 16 12:32:18.139929 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 16 12:32:18.139929 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Id: b5f451e0f5c945d8ade3c2a4ea3398c2 Jun 16 12:32:18.139929 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-VolumesSnapshotTestJSON-1226929550-project Jun 16 12:32:18.139929 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: method: > Jun 16 12:32:18.139929 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: exception: Instance 3c592360-3de6-4be0-9c5e-c0bbd8008a46 could not be found. Jun 16 12:32:18.139929 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: action_args: {'id': '3c592360-3de6-4be0-9c5e-c0bbd8008a46'} Jun 16 12:32:18.140767 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:32:18.140767 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:32:18.140767 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:32:18.140767 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:32:18.140767 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:32:18.140767 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:32:18.140767 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:32:18.140767 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:32:18.140767 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:32:18.140767 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:32:18.140767 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c592360-3de6-4be0-9c5e-c0bbd8008a46 could not be found. Jun 16 12:32:18.140767 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:32:18.140767 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:32:18.140767 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:32:18.140767 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:32:18.140767 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:32:18.140767 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:32:18.140767 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:32:18.140767 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:32:18.140767 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:32:18.142374 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:32:18.142374 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 12:32:18.142374 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 12:32:18.142374 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:32:18.142374 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:32:18.142374 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:32:18.142374 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:32:18.142374 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c592360-3de6-4be0-9c5e-c0bbd8008a46 could not be found. Jun 16 12:32:18.142374 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:32:18.142374 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:32:18.142374 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:32:18.142374 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:32:18.142374 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:32:18.142374 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:32:18.142374 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:32:18.142374 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:32:18.142374 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c592360-3de6-4be0-9c5e-c0bbd8008a46 could not be found. Jun 16 12:32:18.142374 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:32:18.143676 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-17e2570e-3b3e-405f-bb2a-0962c014fef5 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] Returning 404 to user: Instance 3c592360-3de6-4be0-9c5e-c0bbd8008a46 could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:32:18.143676 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-17e2570e-3b3e-405f-bb2a-0962c014fef5 tempest-VolumesSnapshotTestJSON-1226929550 tempest-VolumesSnapshotTestJSON-1226929550-project] 10.222.0.45 "GET /compute/v2.1/servers/3c592360-3de6-4be0-9c5e-c0bbd8008a46" status: 404 len: 111 microversion: 2.1 time: 0.028678 Jun 16 12:32:18.143676 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 325/657] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:32:18 2022] GET /compute/v2.1/servers/3c592360-3de6-4be0-9c5e-c0bbd8008a46 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 12:32:18.684376 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-53986cd1-fa49-46eb-86a1-5b513d9ce376 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:32:18.685396 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-53986cd1-fa49-46eb-86a1-5b513d9ce376 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] [instance: 17f61c67-8ad3-49b1-9efa-045274e693b2] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:32:18.691536 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-53986cd1-fa49-46eb-86a1-5b513d9ce376 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:18.691979 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-53986cd1-fa49-46eb-86a1-5b513d9ce376 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:18.692729 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-53986cd1-fa49-46eb-86a1-5b513d9ce376 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:18.693157 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-53986cd1-fa49-46eb-86a1-5b513d9ce376 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:18.766347 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-53986cd1-fa49-46eb-86a1-5b513d9ce376 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] 10.222.0.45 "POST /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2/action" status: 202 len: 0 microversion: 2.1 time: 0.086948 Jun 16 12:32:18.766982 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 333/658] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Jun 16 12:32:18 2022] POST /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 12:32:18.775559 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-51302dc6-0c21-4e11-815b-2b677a60e974 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:32:18.776205 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-51302dc6-0c21-4e11-815b-2b677a60e974 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] [instance: 17f61c67-8ad3-49b1-9efa-045274e693b2] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:32:18.782377 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-51302dc6-0c21-4e11-815b-2b677a60e974 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:18.782829 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-51302dc6-0c21-4e11-815b-2b677a60e974 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:18.783643 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-51302dc6-0c21-4e11-815b-2b677a60e974 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:18.784040 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-51302dc6-0c21-4e11-815b-2b677a60e974 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:18.941170 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-51302dc6-0c21-4e11-815b-2b677a60e974 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e645784fea14d4785df3eefabf77383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01904f10607d4b4bb91b807bff7ba8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:32:18.949690 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-51302dc6-0c21-4e11-815b-2b677a60e974 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] 10.222.0.45 "GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2" status: 200 len: 1751 microversion: 2.1 time: 0.178644 Jun 16 12:32:18.950287 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 326/659] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:32:18 2022] GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2 => generated 1751 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:32:19.968243 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-15b42e63-9b22-4641-aeca-7b1aa67ac48e tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:32:19.968951 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-15b42e63-9b22-4641-aeca-7b1aa67ac48e tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] [instance: 17f61c67-8ad3-49b1-9efa-045274e693b2] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:32:19.975140 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-15b42e63-9b22-4641-aeca-7b1aa67ac48e tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:19.975591 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-15b42e63-9b22-4641-aeca-7b1aa67ac48e tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:19.976385 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-15b42e63-9b22-4641-aeca-7b1aa67ac48e tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:19.976823 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-15b42e63-9b22-4641-aeca-7b1aa67ac48e tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:20.121156 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-15b42e63-9b22-4641-aeca-7b1aa67ac48e tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e645784fea14d4785df3eefabf77383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01904f10607d4b4bb91b807bff7ba8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:32:20.128943 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-15b42e63-9b22-4641-aeca-7b1aa67ac48e tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] 10.222.0.45 "GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2" status: 200 len: 1756 microversion: 2.1 time: 0.165421 Jun 16 12:32:20.129496 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 334/660] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:32:19 2022] GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:32:21.146136 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ba25b6d2-b560-465a-8eb2-008d4687107c tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:32:21.146750 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ba25b6d2-b560-465a-8eb2-008d4687107c tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] [instance: 17f61c67-8ad3-49b1-9efa-045274e693b2] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:32:21.153442 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ba25b6d2-b560-465a-8eb2-008d4687107c tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:21.153924 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ba25b6d2-b560-465a-8eb2-008d4687107c tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:21.154717 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ba25b6d2-b560-465a-8eb2-008d4687107c tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:21.155154 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ba25b6d2-b560-465a-8eb2-008d4687107c tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:21.296047 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ba25b6d2-b560-465a-8eb2-008d4687107c tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e645784fea14d4785df3eefabf77383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01904f10607d4b4bb91b807bff7ba8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:32:21.303873 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ba25b6d2-b560-465a-8eb2-008d4687107c tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] 10.222.0.45 "GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2" status: 200 len: 1756 microversion: 2.1 time: 0.161618 Jun 16 12:32:21.304436 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 327/661] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:32:21 2022] GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:32:22.320605 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1c916902-6eba-4789-a956-a612889c2dd7 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:32:22.321490 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1c916902-6eba-4789-a956-a612889c2dd7 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] [instance: 17f61c67-8ad3-49b1-9efa-045274e693b2] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:32:22.328012 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1c916902-6eba-4789-a956-a612889c2dd7 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:22.328488 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1c916902-6eba-4789-a956-a612889c2dd7 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:22.329356 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1c916902-6eba-4789-a956-a612889c2dd7 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:22.329668 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1c916902-6eba-4789-a956-a612889c2dd7 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:22.470628 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1c916902-6eba-4789-a956-a612889c2dd7 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e645784fea14d4785df3eefabf77383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01904f10607d4b4bb91b807bff7ba8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:32:22.479536 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1c916902-6eba-4789-a956-a612889c2dd7 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] 10.222.0.45 "GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2" status: 200 len: 1756 microversion: 2.1 time: 0.162676 Jun 16 12:32:22.480108 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 335/662] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:32:22 2022] GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:32:23.497642 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3ef78f92-efee-4feb-8aa2-4f632f19b8f0 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:32:23.498289 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3ef78f92-efee-4feb-8aa2-4f632f19b8f0 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] [instance: 17f61c67-8ad3-49b1-9efa-045274e693b2] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:32:23.504805 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3ef78f92-efee-4feb-8aa2-4f632f19b8f0 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:23.505250 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3ef78f92-efee-4feb-8aa2-4f632f19b8f0 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:23.506026 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3ef78f92-efee-4feb-8aa2-4f632f19b8f0 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:23.506456 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3ef78f92-efee-4feb-8aa2-4f632f19b8f0 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:23.657421 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3ef78f92-efee-4feb-8aa2-4f632f19b8f0 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e645784fea14d4785df3eefabf77383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01904f10607d4b4bb91b807bff7ba8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:32:23.665942 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3ef78f92-efee-4feb-8aa2-4f632f19b8f0 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] 10.222.0.45 "GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2" status: 200 len: 1756 microversion: 2.1 time: 0.172160 Jun 16 12:32:23.666498 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 328/663] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:32:23 2022] GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:32:24.682608 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-dab02996-6062-4e69-a16f-99ae344344c6 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:32:24.683217 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-dab02996-6062-4e69-a16f-99ae344344c6 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] [instance: 17f61c67-8ad3-49b1-9efa-045274e693b2] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:32:24.689750 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dab02996-6062-4e69-a16f-99ae344344c6 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:24.690230 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dab02996-6062-4e69-a16f-99ae344344c6 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:24.690985 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dab02996-6062-4e69-a16f-99ae344344c6 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:24.691418 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dab02996-6062-4e69-a16f-99ae344344c6 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:24.839230 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-dab02996-6062-4e69-a16f-99ae344344c6 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e645784fea14d4785df3eefabf77383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01904f10607d4b4bb91b807bff7ba8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:32:24.847227 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-dab02996-6062-4e69-a16f-99ae344344c6 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] 10.222.0.45 "GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2" status: 200 len: 1756 microversion: 2.1 time: 0.168446 Jun 16 12:32:24.857662 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 336/664] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:32:24 2022] GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:32:25.865275 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-54ed2636-d489-4860-bb70-2ce2cd2c6ea1 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:32:25.865923 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-54ed2636-d489-4860-bb70-2ce2cd2c6ea1 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] [instance: 17f61c67-8ad3-49b1-9efa-045274e693b2] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:32:25.873597 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-54ed2636-d489-4860-bb70-2ce2cd2c6ea1 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:25.874085 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-54ed2636-d489-4860-bb70-2ce2cd2c6ea1 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:25.874846 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-54ed2636-d489-4860-bb70-2ce2cd2c6ea1 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:25.875279 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-54ed2636-d489-4860-bb70-2ce2cd2c6ea1 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:26.019253 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-54ed2636-d489-4860-bb70-2ce2cd2c6ea1 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e645784fea14d4785df3eefabf77383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01904f10607d4b4bb91b807bff7ba8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:32:26.028076 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-54ed2636-d489-4860-bb70-2ce2cd2c6ea1 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] 10.222.0.45 "GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2" status: 200 len: 1756 microversion: 2.1 time: 0.166532 Jun 16 12:32:26.028646 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 329/665] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:32:25 2022] GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:32:27.045069 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-9e204bb7-eb24-4d86-b202-f74307bad128 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:32:27.045668 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-9e204bb7-eb24-4d86-b202-f74307bad128 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] [instance: 17f61c67-8ad3-49b1-9efa-045274e693b2] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:32:27.052114 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9e204bb7-eb24-4d86-b202-f74307bad128 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:27.052591 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9e204bb7-eb24-4d86-b202-f74307bad128 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:27.053349 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9e204bb7-eb24-4d86-b202-f74307bad128 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:27.053783 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9e204bb7-eb24-4d86-b202-f74307bad128 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:27.193040 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-9e204bb7-eb24-4d86-b202-f74307bad128 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e645784fea14d4785df3eefabf77383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01904f10607d4b4bb91b807bff7ba8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:32:27.201807 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-9e204bb7-eb24-4d86-b202-f74307bad128 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] 10.222.0.45 "GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2" status: 200 len: 1756 microversion: 2.1 time: 0.161164 Jun 16 12:32:27.211270 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 337/666] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:32:27 2022] GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2 => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:32:28.221099 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b0c93bf2-3175-4daf-bb82-7241e8d82db5 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:32:28.222034 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b0c93bf2-3175-4daf-bb82-7241e8d82db5 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] [instance: 17f61c67-8ad3-49b1-9efa-045274e693b2] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:32:28.228593 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b0c93bf2-3175-4daf-bb82-7241e8d82db5 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:28.229529 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b0c93bf2-3175-4daf-bb82-7241e8d82db5 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:28.230518 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b0c93bf2-3175-4daf-bb82-7241e8d82db5 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:28.230675 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d46e4cf4-78af-4c6b-897c-fa0bc556a546 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d9ef1a7a-3570-47da-9ae3-aa36a08c2a0f"}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:32:28.231125 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b0c93bf2-3175-4daf-bb82-7241e8d82db5 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:28.231790 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d46e4cf4-78af-4c6b-897c-fa0bc556a546 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c2472931-f1a1-4aec-963a-63a7495b733b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:32:28.238266 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d46e4cf4-78af-4c6b-897c-fa0bc556a546 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:28.238753 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d46e4cf4-78af-4c6b-897c-fa0bc556a546 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:28.239590 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d46e4cf4-78af-4c6b-897c-fa0bc556a546 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:28.240027 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d46e4cf4-78af-4c6b-897c-fa0bc556a546 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:28.381345 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b0c93bf2-3175-4daf-bb82-7241e8d82db5 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e645784fea14d4785df3eefabf77383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01904f10607d4b4bb91b807bff7ba8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:32:28.389457 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b0c93bf2-3175-4daf-bb82-7241e8d82db5 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] 10.222.0.45 "GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2" status: 200 len: 1756 microversion: 2.1 time: 0.173639 Jun 16 12:32:28.390054 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 338/667] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:32:28 2022] GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2 => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:32:28.509205 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d46e4cf4-78af-4c6b-897c-fa0bc556a546 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "POST /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.385620 Jun 16 12:32:28.509802 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 330/668] 10.222.0.45 () {60 vars in 1322 bytes} [Thu Jun 16 12:32:28 2022] POST /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b/os-volume_attachments => generated 194 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:32:29.406237 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4c680a29-8c0c-4d6f-96a7-f27c21716aea tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:32:29.407096 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4c680a29-8c0c-4d6f-96a7-f27c21716aea tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] [instance: 17f61c67-8ad3-49b1-9efa-045274e693b2] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:32:29.413449 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4c680a29-8c0c-4d6f-96a7-f27c21716aea tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:29.413924 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4c680a29-8c0c-4d6f-96a7-f27c21716aea tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:29.414698 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4c680a29-8c0c-4d6f-96a7-f27c21716aea tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:29.415110 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4c680a29-8c0c-4d6f-96a7-f27c21716aea tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:29.554460 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4c680a29-8c0c-4d6f-96a7-f27c21716aea tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e645784fea14d4785df3eefabf77383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01904f10607d4b4bb91b807bff7ba8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:32:29.563000 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4c680a29-8c0c-4d6f-96a7-f27c21716aea tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] 10.222.0.45 "GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2" status: 200 len: 1756 microversion: 2.1 time: 0.160587 Jun 16 12:32:29.563566 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 339/669] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:32:29 2022] GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2 => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:32:30.580815 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b863314b-3265-4985-890a-85931a3e89ca tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:32:30.581503 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b863314b-3265-4985-890a-85931a3e89ca tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] [instance: 17f61c67-8ad3-49b1-9efa-045274e693b2] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:32:30.587746 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b863314b-3265-4985-890a-85931a3e89ca tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:30.588878 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b863314b-3265-4985-890a-85931a3e89ca tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:30.589768 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b863314b-3265-4985-890a-85931a3e89ca tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:30.590230 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b863314b-3265-4985-890a-85931a3e89ca tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:30.732650 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b863314b-3265-4985-890a-85931a3e89ca tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e645784fea14d4785df3eefabf77383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01904f10607d4b4bb91b807bff7ba8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:32:30.740502 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b863314b-3265-4985-890a-85931a3e89ca tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] 10.222.0.45 "GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2" status: 200 len: 1756 microversion: 2.1 time: 0.164259 Jun 16 12:32:30.741063 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 331/670] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:32:30 2022] GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:32:31.757087 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-72b6ecbd-70ad-452a-b55b-c744dda33628 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:32:31.757701 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-72b6ecbd-70ad-452a-b55b-c744dda33628 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] [instance: 17f61c67-8ad3-49b1-9efa-045274e693b2] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:32:31.764459 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-72b6ecbd-70ad-452a-b55b-c744dda33628 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:31.764902 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-72b6ecbd-70ad-452a-b55b-c744dda33628 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:31.765658 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-72b6ecbd-70ad-452a-b55b-c744dda33628 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:31.766128 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-72b6ecbd-70ad-452a-b55b-c744dda33628 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:31.914828 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-72b6ecbd-70ad-452a-b55b-c744dda33628 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e645784fea14d4785df3eefabf77383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01904f10607d4b4bb91b807bff7ba8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:32:31.922860 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-72b6ecbd-70ad-452a-b55b-c744dda33628 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] 10.222.0.45 "GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2" status: 200 len: 1756 microversion: 2.1 time: 0.169541 Jun 16 12:32:31.923422 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 340/671] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:32:31 2022] GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:32:32.939662 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c3cde1ef-9edf-4b27-8983-8f665ccc879c tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:32:32.940201 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c3cde1ef-9edf-4b27-8983-8f665ccc879c tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] [instance: 17f61c67-8ad3-49b1-9efa-045274e693b2] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:32:32.946757 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c3cde1ef-9edf-4b27-8983-8f665ccc879c tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:32.947239 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c3cde1ef-9edf-4b27-8983-8f665ccc879c tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:32.948003 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c3cde1ef-9edf-4b27-8983-8f665ccc879c tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:32.948443 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c3cde1ef-9edf-4b27-8983-8f665ccc879c tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:33.087718 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c3cde1ef-9edf-4b27-8983-8f665ccc879c tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e645784fea14d4785df3eefabf77383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01904f10607d4b4bb91b807bff7ba8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:32:33.096166 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c3cde1ef-9edf-4b27-8983-8f665ccc879c tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] 10.222.0.45 "GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2" status: 200 len: 1756 microversion: 2.1 time: 0.160388 Jun 16 12:32:33.096727 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 332/672] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:32:32 2022] GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2 => generated 1756 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:32:34.114046 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-04f560c4-a01c-4402-ad9e-4016a4c01896 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:32:34.114679 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-04f560c4-a01c-4402-ad9e-4016a4c01896 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] [instance: 17f61c67-8ad3-49b1-9efa-045274e693b2] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:32:34.121363 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-04f560c4-a01c-4402-ad9e-4016a4c01896 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:34.121832 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-04f560c4-a01c-4402-ad9e-4016a4c01896 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:34.122653 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-04f560c4-a01c-4402-ad9e-4016a4c01896 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:34.123091 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-04f560c4-a01c-4402-ad9e-4016a4c01896 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:34.283544 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-04f560c4-a01c-4402-ad9e-4016a4c01896 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e645784fea14d4785df3eefabf77383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01904f10607d4b4bb91b807bff7ba8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:32:34.292095 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-04f560c4-a01c-4402-ad9e-4016a4c01896 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] 10.222.0.45 "GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2" status: 200 len: 1756 microversion: 2.1 time: 0.181603 Jun 16 12:32:34.292659 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 341/673] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:32:34 2022] GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2 => generated 1756 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:32:35.308676 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f9c39696-ec09-43b0-987b-205c9a21bfc6 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:32:35.309292 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f9c39696-ec09-43b0-987b-205c9a21bfc6 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] [instance: 17f61c67-8ad3-49b1-9efa-045274e693b2] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:32:35.315936 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f9c39696-ec09-43b0-987b-205c9a21bfc6 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:35.316384 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f9c39696-ec09-43b0-987b-205c9a21bfc6 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:35.317144 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f9c39696-ec09-43b0-987b-205c9a21bfc6 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:35.317607 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f9c39696-ec09-43b0-987b-205c9a21bfc6 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:35.471804 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f9c39696-ec09-43b0-987b-205c9a21bfc6 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e645784fea14d4785df3eefabf77383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01904f10607d4b4bb91b807bff7ba8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:32:35.479795 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f9c39696-ec09-43b0-987b-205c9a21bfc6 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] 10.222.0.45 "GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2" status: 200 len: 1756 microversion: 2.1 time: 0.175096 Jun 16 12:32:35.480300 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 333/674] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:32:35 2022] GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2 => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:32:36.496999 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0d6612c7-832c-4f37-ac3c-f56d678a9892 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:32:36.497607 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0d6612c7-832c-4f37-ac3c-f56d678a9892 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] [instance: 17f61c67-8ad3-49b1-9efa-045274e693b2] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:32:36.504025 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0d6612c7-832c-4f37-ac3c-f56d678a9892 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:36.504469 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0d6612c7-832c-4f37-ac3c-f56d678a9892 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:36.505227 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0d6612c7-832c-4f37-ac3c-f56d678a9892 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:36.505653 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0d6612c7-832c-4f37-ac3c-f56d678a9892 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:36.659781 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0d6612c7-832c-4f37-ac3c-f56d678a9892 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e645784fea14d4785df3eefabf77383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01904f10607d4b4bb91b807bff7ba8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:32:36.668695 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0d6612c7-832c-4f37-ac3c-f56d678a9892 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] 10.222.0.45 "GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2" status: 200 len: 1756 microversion: 2.1 time: 0.175953 Jun 16 12:32:36.669293 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 342/675] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:32:36 2022] GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2 => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:32:37.685508 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fc678879-6658-4d76-9691-55ed00118fd8 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:32:37.686152 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-fc678879-6658-4d76-9691-55ed00118fd8 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] [instance: 17f61c67-8ad3-49b1-9efa-045274e693b2] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:32:37.692505 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fc678879-6658-4d76-9691-55ed00118fd8 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:37.692953 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fc678879-6658-4d76-9691-55ed00118fd8 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:37.693717 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fc678879-6658-4d76-9691-55ed00118fd8 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:37.694174 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fc678879-6658-4d76-9691-55ed00118fd8 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:37.837292 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fc678879-6658-4d76-9691-55ed00118fd8 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e645784fea14d4785df3eefabf77383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01904f10607d4b4bb91b807bff7ba8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:32:37.846354 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-fc678879-6658-4d76-9691-55ed00118fd8 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] 10.222.0.45 "GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2" status: 200 len: 1756 microversion: 2.1 time: 0.164570 Jun 16 12:32:37.847231 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 334/676] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:32:37 2022] GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:32:38.864260 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ae11e63f-51e2-4c19-8606-c6ec09bd04d6 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:32:38.864878 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ae11e63f-51e2-4c19-8606-c6ec09bd04d6 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] [instance: 17f61c67-8ad3-49b1-9efa-045274e693b2] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:32:38.871690 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ae11e63f-51e2-4c19-8606-c6ec09bd04d6 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:38.872138 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ae11e63f-51e2-4c19-8606-c6ec09bd04d6 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:38.872908 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ae11e63f-51e2-4c19-8606-c6ec09bd04d6 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:38.873346 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ae11e63f-51e2-4c19-8606-c6ec09bd04d6 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:39.019985 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ae11e63f-51e2-4c19-8606-c6ec09bd04d6 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e645784fea14d4785df3eefabf77383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01904f10607d4b4bb91b807bff7ba8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:32:39.028493 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ae11e63f-51e2-4c19-8606-c6ec09bd04d6 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] 10.222.0.45 "GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2" status: 200 len: 1756 microversion: 2.1 time: 0.168328 Jun 16 12:32:39.029076 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 343/677] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:32:38 2022] GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:32:40.046360 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-010b46ad-2a02-40e3-bc7d-d701ce231851 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:32:40.047003 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-010b46ad-2a02-40e3-bc7d-d701ce231851 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] [instance: 17f61c67-8ad3-49b1-9efa-045274e693b2] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:32:40.053406 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-010b46ad-2a02-40e3-bc7d-d701ce231851 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:40.053861 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-010b46ad-2a02-40e3-bc7d-d701ce231851 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:40.054648 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-010b46ad-2a02-40e3-bc7d-d701ce231851 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:40.055088 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-010b46ad-2a02-40e3-bc7d-d701ce231851 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:40.218629 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-010b46ad-2a02-40e3-bc7d-d701ce231851 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e645784fea14d4785df3eefabf77383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01904f10607d4b4bb91b807bff7ba8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:32:40.227870 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-010b46ad-2a02-40e3-bc7d-d701ce231851 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] 10.222.0.45 "GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2" status: 200 len: 1759 microversion: 2.1 time: 0.186014 Jun 16 12:32:40.228516 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 335/678] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:32:40 2022] GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2 => generated 1759 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:32:41.286311 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2f5947b4-a363-4905-9739-46e91ec3fc46 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:32:41.287297 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2f5947b4-a363-4905-9739-46e91ec3fc46 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c2472931-f1a1-4aec-963a-63a7495b733b] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:32:41.293722 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2f5947b4-a363-4905-9739-46e91ec3fc46 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:41.294207 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2f5947b4-a363-4905-9739-46e91ec3fc46 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:41.294995 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2f5947b4-a363-4905-9739-46e91ec3fc46 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:41.295437 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2f5947b4-a363-4905-9739-46e91ec3fc46 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:41.311801 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:32:41.318514 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.objects.instance [None req-2f5947b4-a363-4905-9739-46e91ec3fc46 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lazy-loading 'flavor' on Instance uuid c2472931-f1a1-4aec-963a-63a7495b733b {{(pid=117607) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 12:32:41.448646 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2f5947b4-a363-4905-9739-46e91ec3fc46 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "POST /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b/action" status: 200 len: 32 microversion: 2.1 time: 0.165398 Jun 16 12:32:41.449248 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 344/679] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Jun 16 12:32:41 2022] POST /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b/action => generated 32 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 12:32:41.458694 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a0cc9d92-89ce-4b1b-8a40-55590899d13a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:32:41.459460 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a0cc9d92-89ce-4b1b-8a40-55590899d13a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c2472931-f1a1-4aec-963a-63a7495b733b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:32:41.468654 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a0cc9d92-89ce-4b1b-8a40-55590899d13a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:41.469135 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a0cc9d92-89ce-4b1b-8a40-55590899d13a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:41.469920 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a0cc9d92-89ce-4b1b-8a40-55590899d13a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:41.470373 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a0cc9d92-89ce-4b1b-8a40-55590899d13a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:41.688354 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a0cc9d92-89ce-4b1b-8a40-55590899d13a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:32:41.696256 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a0cc9d92-89ce-4b1b-8a40-55590899d13a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b" status: 200 len: 1738 microversion: 2.1 time: 0.241786 Jun 16 12:32:41.696761 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 336/680] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:32:41 2022] GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b => generated 1738 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:32:42.714725 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b5316fe3-7d7e-4b74-9443-1527a5f99ad9 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:32:42.715458 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b5316fe3-7d7e-4b74-9443-1527a5f99ad9 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c2472931-f1a1-4aec-963a-63a7495b733b] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:32:42.722113 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b5316fe3-7d7e-4b74-9443-1527a5f99ad9 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:42.722564 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b5316fe3-7d7e-4b74-9443-1527a5f99ad9 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:42.723329 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b5316fe3-7d7e-4b74-9443-1527a5f99ad9 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:42.723769 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b5316fe3-7d7e-4b74-9443-1527a5f99ad9 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:43.097772 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b5316fe3-7d7e-4b74-9443-1527a5f99ad9 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:32:43.106423 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b5316fe3-7d7e-4b74-9443-1527a5f99ad9 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b" status: 200 len: 1738 microversion: 2.1 time: 0.396045 Jun 16 12:32:43.107005 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 345/681] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:32:42 2022] GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b => generated 1738 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:32:44.124183 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d9dfc2a0-9b3f-49b0-9727-58f27465da97 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:32:44.125831 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d9dfc2a0-9b3f-49b0-9727-58f27465da97 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c2472931-f1a1-4aec-963a-63a7495b733b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:32:44.128283 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=31 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:32:44.135668 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d9dfc2a0-9b3f-49b0-9727-58f27465da97 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:44.136129 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d9dfc2a0-9b3f-49b0-9727-58f27465da97 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:44.136909 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d9dfc2a0-9b3f-49b0-9727-58f27465da97 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:44.137495 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d9dfc2a0-9b3f-49b0-9727-58f27465da97 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:44.140604 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:32:44.271036 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d9dfc2a0-9b3f-49b0-9727-58f27465da97 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:32:44.279649 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d9dfc2a0-9b3f-49b0-9727-58f27465da97 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b" status: 200 len: 1738 microversion: 2.1 time: 0.159269 Jun 16 12:32:44.280221 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 337/682] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:32:44 2022] GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b => generated 1738 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:32:45.297207 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-fef0288f-1ca1-4883-95dc-e6fbd38d773a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:32:45.297814 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-fef0288f-1ca1-4883-95dc-e6fbd38d773a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c2472931-f1a1-4aec-963a-63a7495b733b] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:32:45.301418 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:32:45.306107 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fef0288f-1ca1-4883-95dc-e6fbd38d773a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:45.306585 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fef0288f-1ca1-4883-95dc-e6fbd38d773a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:45.308185 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fef0288f-1ca1-4883-95dc-e6fbd38d773a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:45.308511 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fef0288f-1ca1-4883-95dc-e6fbd38d773a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:45.563616 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-fef0288f-1ca1-4883-95dc-e6fbd38d773a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:32:45.572519 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-fef0288f-1ca1-4883-95dc-e6fbd38d773a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b" status: 200 len: 1738 microversion: 2.1 time: 0.278959 Jun 16 12:32:45.573680 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 346/683] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:32:45 2022] GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b => generated 1738 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:32:46.590213 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9c52e6a7-5fa2-4f9c-99df-86a1133d435e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:32:46.591377 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9c52e6a7-5fa2-4f9c-99df-86a1133d435e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c2472931-f1a1-4aec-963a-63a7495b733b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:32:46.598909 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9c52e6a7-5fa2-4f9c-99df-86a1133d435e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:46.599582 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9c52e6a7-5fa2-4f9c-99df-86a1133d435e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:46.600515 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9c52e6a7-5fa2-4f9c-99df-86a1133d435e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:46.601245 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9c52e6a7-5fa2-4f9c-99df-86a1133d435e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:46.802598 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9c52e6a7-5fa2-4f9c-99df-86a1133d435e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:32:46.812538 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9c52e6a7-5fa2-4f9c-99df-86a1133d435e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b" status: 200 len: 1738 microversion: 2.1 time: 0.226154 Jun 16 12:32:46.813164 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 338/684] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:32:46 2022] GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b => generated 1738 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:32:47.832300 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-eb182a81-ac22-4dd6-b61e-bf9390a5fc5d tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:32:47.833622 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-eb182a81-ac22-4dd6-b61e-bf9390a5fc5d tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c2472931-f1a1-4aec-963a-63a7495b733b] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:32:47.841154 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-eb182a81-ac22-4dd6-b61e-bf9390a5fc5d tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:47.841856 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-eb182a81-ac22-4dd6-b61e-bf9390a5fc5d tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:47.842848 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-eb182a81-ac22-4dd6-b61e-bf9390a5fc5d tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:47.843573 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-eb182a81-ac22-4dd6-b61e-bf9390a5fc5d tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:48.023417 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-eb182a81-ac22-4dd6-b61e-bf9390a5fc5d tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:32:48.032770 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-eb182a81-ac22-4dd6-b61e-bf9390a5fc5d tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b" status: 200 len: 1738 microversion: 2.1 time: 0.205985 Jun 16 12:32:48.033532 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 347/685] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:32:47 2022] GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b => generated 1738 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:32:49.052046 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-526aeed0-edb9-4797-a1c9-ff85096a0747 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:32:49.054652 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-526aeed0-edb9-4797-a1c9-ff85096a0747 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c2472931-f1a1-4aec-963a-63a7495b733b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:32:49.063138 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-526aeed0-edb9-4797-a1c9-ff85096a0747 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:49.063685 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-526aeed0-edb9-4797-a1c9-ff85096a0747 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:49.064524 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-526aeed0-edb9-4797-a1c9-ff85096a0747 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:49.065182 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-526aeed0-edb9-4797-a1c9-ff85096a0747 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:49.227468 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-526aeed0-edb9-4797-a1c9-ff85096a0747 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:32:49.236935 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-526aeed0-edb9-4797-a1c9-ff85096a0747 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b" status: 200 len: 1738 microversion: 2.1 time: 0.189755 Jun 16 12:32:49.237977 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 339/686] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:32:49 2022] GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b => generated 1738 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:32:50.253830 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c52ed795-e405-4f17-98a9-6a188f5d9ded tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:32:50.257358 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c52ed795-e405-4f17-98a9-6a188f5d9ded tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c2472931-f1a1-4aec-963a-63a7495b733b] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:32:50.267482 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c52ed795-e405-4f17-98a9-6a188f5d9ded tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:50.268014 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c52ed795-e405-4f17-98a9-6a188f5d9ded tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:50.268888 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c52ed795-e405-4f17-98a9-6a188f5d9ded tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:50.269403 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c52ed795-e405-4f17-98a9-6a188f5d9ded tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:50.447637 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c52ed795-e405-4f17-98a9-6a188f5d9ded tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:32:50.462085 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c52ed795-e405-4f17-98a9-6a188f5d9ded tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b" status: 200 len: 1738 microversion: 2.1 time: 0.211887 Jun 16 12:32:50.474446 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 348/687] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:32:50 2022] GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b => generated 1738 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:32:51.479951 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-162c243a-bf94-42c6-b7e2-b5d275c2dbe6 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:32:51.480572 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-162c243a-bf94-42c6-b7e2-b5d275c2dbe6 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c2472931-f1a1-4aec-963a-63a7495b733b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:32:51.498999 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-162c243a-bf94-42c6-b7e2-b5d275c2dbe6 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:51.507092 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-162c243a-bf94-42c6-b7e2-b5d275c2dbe6 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:51.511800 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-162c243a-bf94-42c6-b7e2-b5d275c2dbe6 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:51.514187 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-162c243a-bf94-42c6-b7e2-b5d275c2dbe6 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:51.788059 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-162c243a-bf94-42c6-b7e2-b5d275c2dbe6 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:32:51.801064 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-162c243a-bf94-42c6-b7e2-b5d275c2dbe6 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b" status: 200 len: 1738 microversion: 2.1 time: 0.325104 Jun 16 12:32:51.813742 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 340/688] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:32:51 2022] GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b => generated 1738 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:32:52.825077 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-9e652e93-b552-4c4f-9fc3-bd87398c41ea tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:32:52.825681 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-9e652e93-b552-4c4f-9fc3-bd87398c41ea tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c2472931-f1a1-4aec-963a-63a7495b733b] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:32:52.832958 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9e652e93-b552-4c4f-9fc3-bd87398c41ea tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:52.833397 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9e652e93-b552-4c4f-9fc3-bd87398c41ea tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:52.836624 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9e652e93-b552-4c4f-9fc3-bd87398c41ea tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:52.837318 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9e652e93-b552-4c4f-9fc3-bd87398c41ea tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:53.068197 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-9e652e93-b552-4c4f-9fc3-bd87398c41ea tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:32:53.078983 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-9e652e93-b552-4c4f-9fc3-bd87398c41ea tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b" status: 200 len: 1738 microversion: 2.1 time: 0.262753 Jun 16 12:32:53.082309 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 349/689] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:32:52 2022] GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b => generated 1738 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:32:54.099514 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a2797b61-cbc7-4b79-9406-4b0a9f4fee2e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:32:54.100983 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a2797b61-cbc7-4b79-9406-4b0a9f4fee2e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c2472931-f1a1-4aec-963a-63a7495b733b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:32:54.111441 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a2797b61-cbc7-4b79-9406-4b0a9f4fee2e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:54.112242 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a2797b61-cbc7-4b79-9406-4b0a9f4fee2e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:54.114442 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a2797b61-cbc7-4b79-9406-4b0a9f4fee2e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:54.115136 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a2797b61-cbc7-4b79-9406-4b0a9f4fee2e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:54.270828 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a2797b61-cbc7-4b79-9406-4b0a9f4fee2e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:32:54.279459 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a2797b61-cbc7-4b79-9406-4b0a9f4fee2e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b" status: 200 len: 1738 microversion: 2.1 time: 0.185405 Jun 16 12:32:54.280048 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 341/690] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:32:54 2022] GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b => generated 1738 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:32:54.439446 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-45e0cfad-16d5-4b74-b64c-e49cab0cecc1 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Action: 'create', calling method: .version_select at 0x7f7c71fdeee0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1163784128", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATjEF33qgMiaAKLanPZOaRIE0qj1I0bWhMHAYm8Czess9YvGhqyfJiSEuPe5Pspwuzmp5gAPwtZAGs0F6pThFTZ+9mDtLkjd1Eylr3kOiqH4y/MEC3qw0uhNz8o3qAsVQ=="}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:32:54.457206 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-45e0cfad-16d5-4b74-b64c-e49cab0cecc1 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Getting quotas for project 9cf2d3eca81148afa04159506decfdce. Resources: {'key_pairs'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 12:32:54.461049 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-45e0cfad-16d5-4b74-b64c-e49cab0cecc1 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Getting quotas for user 46f18557a45846c1bd9075f8a0717652 and project 9cf2d3eca81148afa04159506decfdce. Resources: {'key_pairs'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 12:32:54.486279 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-45e0cfad-16d5-4b74-b64c-e49cab0cecc1 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.236598 Jun 16 12:32:54.486962 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 350/691] 10.222.0.45 () {60 vars in 1158 bytes} [Thu Jun 16 12:32:54 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 12:32:55.298107 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a1368d1f-5ea3-417f-b236-8c786203bfd1 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:32:55.298697 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a1368d1f-5ea3-417f-b236-8c786203bfd1 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c2472931-f1a1-4aec-963a-63a7495b733b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:32:55.305993 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a1368d1f-5ea3-417f-b236-8c786203bfd1 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:55.306490 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a1368d1f-5ea3-417f-b236-8c786203bfd1 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:55.308149 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a1368d1f-5ea3-417f-b236-8c786203bfd1 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:55.308588 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a1368d1f-5ea3-417f-b236-8c786203bfd1 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:55.471804 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a1368d1f-5ea3-417f-b236-8c786203bfd1 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:32:55.480440 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a1368d1f-5ea3-417f-b236-8c786203bfd1 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b" status: 200 len: 1738 microversion: 2.1 time: 0.186419 Jun 16 12:32:55.481009 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 342/692] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:32:55 2022] GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b => generated 1738 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:32:56.497419 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4cdbeda2-3158-4a27-88a0-1f22fe7c73af tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:32:56.498065 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4cdbeda2-3158-4a27-88a0-1f22fe7c73af tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c2472931-f1a1-4aec-963a-63a7495b733b] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:32:56.505070 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4cdbeda2-3158-4a27-88a0-1f22fe7c73af tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:56.505653 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4cdbeda2-3158-4a27-88a0-1f22fe7c73af tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:56.506444 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4cdbeda2-3158-4a27-88a0-1f22fe7c73af tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:56.506874 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4cdbeda2-3158-4a27-88a0-1f22fe7c73af tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:56.649201 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4cdbeda2-3158-4a27-88a0-1f22fe7c73af tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:32:56.657978 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4cdbeda2-3158-4a27-88a0-1f22fe7c73af tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b" status: 200 len: 1718 microversion: 2.1 time: 0.164206 Jun 16 12:32:56.658558 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 351/693] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:32:56 2022] GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b => generated 1718 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:32:56.781589 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3114f26d-75af-47f3-b1de-127cd64380e6 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:32:56.782323 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3114f26d-75af-47f3-b1de-127cd64380e6 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c2472931-f1a1-4aec-963a-63a7495b733b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:32:56.789391 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3114f26d-75af-47f3-b1de-127cd64380e6 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:56.789958 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3114f26d-75af-47f3-b1de-127cd64380e6 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:56.790862 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3114f26d-75af-47f3-b1de-127cd64380e6 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:56.791364 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3114f26d-75af-47f3-b1de-127cd64380e6 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:56.879287 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-3114f26d-75af-47f3-b1de-127cd64380e6 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] HTTP exception thrown: Cannot 'detach_volume' instance c2472931-f1a1-4aec-963a-63a7495b733b while it is in vm_state rescued Jun 16 12:32:56.880871 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3114f26d-75af-47f3-b1de-127cd64380e6 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Request method failure captured: Jun 16 12:32:56.880871 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: request: DELETE /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b/os-volume_attachments/d9ef1a7a-3570-47da-9ae3-aa36a08c2a0f HTTP/1.1 Jun 16 12:32:56.880871 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 16 12:32:56.880871 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 16 12:32:56.880871 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Connection: close Jun 16 12:32:56.880871 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 16 12:32:56.880871 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 16 12:32:56.880871 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Host: 10.222.0.45 Jun 16 12:32:56.880871 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 16 12:32:56.880871 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 16 12:32:56.880871 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABiqyGES1jPC9zoTp2cmyHjjCfKzUThVvFVDddjyKIwirFIWtW3ZvKtdRT79lGPcaFE642K8AID4DI8GVJJbegi6HvqkNpIy3K9U8GXQ6HrKIxQ5j39hAm1F4SXapv5IvLs7SJL9UbGXGXJJIr0wozEivmIxAYUgMQ3ylzJESix1mP4Yww Jun 16 12:32:56.880871 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 16 12:32:56.880871 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 16 12:32:56.880871 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 16 12:32:56.880871 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 16 12:32:56.880871 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 16 12:32:56.880871 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 16 12:32:56.880871 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Id: 338412f496e246eebc934f348c539335 Jun 16 12:32:56.880871 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-755756367 Jun 16 12:32:56.880871 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 16 12:32:56.880871 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 16 12:32:56.882510 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/338412f496e246eebc934f348c539335"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/338412f496e246eebc934f348c539335"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_338412f496e246eebc934f348c539335"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/338412f496e246eebc934f348c539335"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Jun 16 12:32:56.882510 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-ServerRescueNegativeTestJSON-755756367 Jun 16 12:32:56.882510 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 338412f496e246eebc934f348c539335 Jun 16 12:32:56.882510 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-755756367 Jun 16 12:32:56.882510 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User: tempest-ServerRescueNegativeTestJSON-755756367-project Jun 16 12:32:56.882510 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 16 12:32:56.882510 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 16 12:32:56.882510 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Id: a333ad2fb1c74ef9a666aa591616d7a2 Jun 16 12:32:56.882510 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-ServerRescueNegativeTestJSON-755756367-project Jun 16 12:32:56.882510 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: method: > Jun 16 12:32:56.882510 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: exception: Cannot 'detach_volume' instance c2472931-f1a1-4aec-963a-63a7495b733b while it is in vm_state rescued Jun 16 12:32:56.883449 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: action_args: {'server_id': 'c2472931-f1a1-4aec-963a-63a7495b733b', 'id': 'd9ef1a7a-3570-47da-9ae3-aa36a08c2a0f'} Jun 16 12:32:56.883449 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:32:56.883449 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:32:56.883449 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 16 12:32:56.883449 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 16 12:32:56.883449 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 12:32:56.883449 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 12:32:56.883449 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 16 12:32:56.883449 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 16 12:32:56.883449 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c2472931-f1a1-4aec-963a-63a7495b733b in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 16 12:32:56.883449 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:32:56.883449 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:32:56.883449 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:32:56.883449 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:32:56.883449 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:32:56.883449 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:32:56.883449 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:32:56.883449 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:32:56.883449 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:32:56.883449 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:32:56.884887 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 16 12:32:56.884887 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 16 12:32:56.884887 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 16 12:32:56.884887 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 16 12:32:56.884887 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance c2472931-f1a1-4aec-963a-63a7495b733b while it is in vm_state rescued Jun 16 12:32:56.884887 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:32:56.884887 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:32:56.884887 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:32:56.884887 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:32:56.884887 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:32:56.884887 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:32:56.884887 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:32:56.884887 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:32:56.884887 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance c2472931-f1a1-4aec-963a-63a7495b733b while it is in vm_state rescued Jun 16 12:32:56.884887 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:32:56.884887 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3114f26d-75af-47f3-b1de-127cd64380e6 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Returning 409 to user: Cannot 'detach_volume' instance c2472931-f1a1-4aec-963a-63a7495b733b while it is in vm_state rescued {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:32:56.886351 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3114f26d-75af-47f3-b1de-127cd64380e6 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "DELETE /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b/os-volume_attachments/d9ef1a7a-3570-47da-9ae3-aa36a08c2a0f" status: 409 len: 152 microversion: 2.1 time: 0.106059 Jun 16 12:32:56.886351 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 343/694] 10.222.0.45 () {58 vars in 1415 bytes} [Thu Jun 16 12:32:56 2022] DELETE /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b/os-volume_attachments/d9ef1a7a-3570-47da-9ae3-aa36a08c2a0f => generated 152 bytes in 107 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 16 12:32:56.891357 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2bf01f83-3a59-490c-8135-da872f1a071e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:32:56.891896 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2bf01f83-3a59-490c-8135-da872f1a071e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c2472931-f1a1-4aec-963a-63a7495b733b] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:32:56.898331 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2bf01f83-3a59-490c-8135-da872f1a071e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:56.898789 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2bf01f83-3a59-490c-8135-da872f1a071e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:56.899575 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2bf01f83-3a59-490c-8135-da872f1a071e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:56.900531 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2bf01f83-3a59-490c-8135-da872f1a071e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:56.975565 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2bf01f83-3a59-490c-8135-da872f1a071e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "POST /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b/action" status: 202 len: 0 microversion: 2.1 time: 0.087451 Jun 16 12:32:56.976220 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 352/695] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Jun 16 12:32:56 2022] POST /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 12:32:56.985592 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-602e8bfa-e59b-45ca-9102-c4b94955fb72 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:32:56.986240 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-602e8bfa-e59b-45ca-9102-c4b94955fb72 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c2472931-f1a1-4aec-963a-63a7495b733b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:32:56.992978 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-602e8bfa-e59b-45ca-9102-c4b94955fb72 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:56.993444 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-602e8bfa-e59b-45ca-9102-c4b94955fb72 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:56.994984 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-602e8bfa-e59b-45ca-9102-c4b94955fb72 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:56.995454 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-602e8bfa-e59b-45ca-9102-c4b94955fb72 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:57.232650 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-602e8bfa-e59b-45ca-9102-c4b94955fb72 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:32:57.241166 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-602e8bfa-e59b-45ca-9102-c4b94955fb72 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b" status: 200 len: 1726 microversion: 2.1 time: 0.259928 Jun 16 12:32:57.241693 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 344/696] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:32:56 2022] GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b => generated 1726 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:32:58.259882 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a32299ef-85fe-4cf1-9037-28383ef3c587 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:32:58.260757 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a32299ef-85fe-4cf1-9037-28383ef3c587 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c2472931-f1a1-4aec-963a-63a7495b733b] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:32:58.268320 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a32299ef-85fe-4cf1-9037-28383ef3c587 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:58.269113 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a32299ef-85fe-4cf1-9037-28383ef3c587 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:58.270301 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a32299ef-85fe-4cf1-9037-28383ef3c587 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:58.271864 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a32299ef-85fe-4cf1-9037-28383ef3c587 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:58.441824 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a32299ef-85fe-4cf1-9037-28383ef3c587 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:32:58.450580 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a32299ef-85fe-4cf1-9037-28383ef3c587 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b" status: 200 len: 1726 microversion: 2.1 time: 0.195353 Jun 16 12:32:58.451662 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 353/697] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:32:58 2022] GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b => generated 1726 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:32:59.467538 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b083bf6c-bdbf-4072-baea-c19b2855b525 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:32:59.468142 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b083bf6c-bdbf-4072-baea-c19b2855b525 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c2472931-f1a1-4aec-963a-63a7495b733b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:32:59.474595 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b083bf6c-bdbf-4072-baea-c19b2855b525 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:59.475043 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b083bf6c-bdbf-4072-baea-c19b2855b525 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:59.475809 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b083bf6c-bdbf-4072-baea-c19b2855b525 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:32:59.476243 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b083bf6c-bdbf-4072-baea-c19b2855b525 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:32:59.854837 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b083bf6c-bdbf-4072-baea-c19b2855b525 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:32:59.863528 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b083bf6c-bdbf-4072-baea-c19b2855b525 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b" status: 200 len: 1726 microversion: 2.1 time: 0.399935 Jun 16 12:32:59.864134 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 345/698] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:32:59 2022] GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b => generated 1726 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:33:00.485116 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-27062105-cf7f-4b96-94b2-6c4632ee1b11 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:00.485669 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-27062105-cf7f-4b96-94b2-6c4632ee1b11 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9abc4b09-7cfc-47dc-b778-684eb2e331b9] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:00.491595 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-27062105-cf7f-4b96-94b2-6c4632ee1b11 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:00.492044 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-27062105-cf7f-4b96-94b2-6c4632ee1b11 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:00.492806 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-27062105-cf7f-4b96-94b2-6c4632ee1b11 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:00.493244 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-27062105-cf7f-4b96-94b2-6c4632ee1b11 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:00.518666 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-27062105-cf7f-4b96-94b2-6c4632ee1b11 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9/ips" status: 200 len: 150 microversion: 2.1 time: 0.148925 Jun 16 12:33:00.519147 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 354/699] 10.222.0.45 () {58 vars in 1247 bytes} [Thu Jun 16 12:33:00 2022] GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9/ips => generated 150 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:33:00.530473 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ff9e6c82-5c55-404a-a0a8-13aeb58ba94b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7a1bc1ef-d211-465a-9784-42fb419181e2"}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:33:00.531861 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ff9e6c82-5c55-404a-a0a8-13aeb58ba94b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9abc4b09-7cfc-47dc-b778-684eb2e331b9] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:00.538830 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ff9e6c82-5c55-404a-a0a8-13aeb58ba94b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:00.539323 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ff9e6c82-5c55-404a-a0a8-13aeb58ba94b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:00.540048 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ff9e6c82-5c55-404a-a0a8-13aeb58ba94b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:00.540482 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ff9e6c82-5c55-404a-a0a8-13aeb58ba94b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:00.624947 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-ff9e6c82-5c55-404a-a0a8-13aeb58ba94b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] HTTP exception thrown: Invalid volume: volume 7a1bc1ef-d211-465a-9784-42fb419181e2 is already attached to instances: ddba5ba6-d9f4-493c-b15b-9443a5426682 Jun 16 12:33:00.626610 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ff9e6c82-5c55-404a-a0a8-13aeb58ba94b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Request method failure captured: Jun 16 12:33:00.626610 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: request: POST /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9/os-volume_attachments HTTP/1.1 Jun 16 12:33:00.626610 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 16 12:33:00.626610 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 16 12:33:00.626610 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Connection: close Jun 16 12:33:00.626610 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Content-Length: 74 Jun 16 12:33:00.626610 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 16 12:33:00.626610 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Host: 10.222.0.45 Jun 16 12:33:00.626610 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 16 12:33:00.626610 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 16 12:33:00.626610 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABiqyGF1I7NNsn9N-NNLw8e7JwWQfFAz21t9AN_OlEcHKfvG-zVtCE3h0xqQLPiYlGgCbqHJIMx6mphLTjEkYrptZmSsukd0-SUbPj3ipfsUXouJgw4LZCCngD_KxZq-5FKd9EOmAaCBK7p8lhdHrTX3rZ5m9BxXUJmHDIk-Sxu6p9pH_c Jun 16 12:33:00.626610 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 16 12:33:00.626610 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 16 12:33:00.626610 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 16 12:33:00.626610 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 16 12:33:00.626610 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 16 12:33:00.626610 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 16 12:33:00.626610 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Id: 3fce886a9a894240a0b3bd3af94d2465 Jun 16 12:33:00.626610 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-AttachVolumeNegativeTest-1612233326 Jun 16 12:33:00.626610 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 16 12:33:00.626610 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 16 12:33:00.628248 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3fce886a9a894240a0b3bd3af94d2465"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3fce886a9a894240a0b3bd3af94d2465"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3fce886a9a894240a0b3bd3af94d2465"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3fce886a9a894240a0b3bd3af94d2465"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Jun 16 12:33:00.628248 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-AttachVolumeNegativeTest-1612233326 Jun 16 12:33:00.628248 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 3fce886a9a894240a0b3bd3af94d2465 Jun 16 12:33:00.628248 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1612233326 Jun 16 12:33:00.628248 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User: tempest-AttachVolumeNegativeTest-1612233326-project Jun 16 12:33:00.628248 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 16 12:33:00.628248 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 16 12:33:00.628248 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Id: ed6b630c60d640afb1325215ea27acef Jun 16 12:33:00.628248 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-AttachVolumeNegativeTest-1612233326-project Jun 16 12:33:00.628248 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Jun 16 12:33:00.628248 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: {"volumeAttachment": {"volumeId": "7a1bc1ef-d211-465a-9784-42fb419181e2"}} Jun 16 12:33:00.628248 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: method: > Jun 16 12:33:00.629333 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: exception: Invalid volume: volume 7a1bc1ef-d211-465a-9784-42fb419181e2 is already attached to instances: ddba5ba6-d9f4-493c-b15b-9443a5426682 Jun 16 12:33:00.629333 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: action_args: {'server_id': '9abc4b09-7cfc-47dc-b778-684eb2e331b9', 'body': {'volumeAttachment': {'volumeId': '7a1bc1ef-d211-465a-9784-42fb419181e2'}}} Jun 16 12:33:00.629333 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:33:00.629333 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:33:00.629333 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 16 12:33:00.629333 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 16 12:33:00.629333 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 12:33:00.629333 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 12:33:00.629333 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 16 12:33:00.629333 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 16 12:33:00.629333 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 16 12:33:00.629333 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 16 12:33:00.629333 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 16 12:33:00.629333 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 16 12:33:00.629333 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 7a1bc1ef-d211-465a-9784-42fb419181e2 is already attached to instances: ddba5ba6-d9f4-493c-b15b-9443a5426682 Jun 16 12:33:00.629333 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:33:00.629333 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:33:00.629333 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:33:00.629333 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:33:00.630843 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:33:00.630843 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:33:00.630843 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:33:00.630843 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:33:00.630843 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:33:00.630843 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:33:00.630843 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 12:33:00.630843 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 12:33:00.630843 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 12:33:00.630843 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 12:33:00.630843 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 12:33:00.630843 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 12:33:00.630843 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 16 12:33:00.630843 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 16 12:33:00.630843 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 7a1bc1ef-d211-465a-9784-42fb419181e2 is already attached to instances: ddba5ba6-d9f4-493c-b15b-9443a5426682 Jun 16 12:33:00.630843 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:33:00.630843 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:33:00.630843 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:33:00.630843 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:33:00.630843 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:33:00.632469 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:33:00.632469 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:33:00.632469 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:33:00.632469 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 7a1bc1ef-d211-465a-9784-42fb419181e2 is already attached to instances: ddba5ba6-d9f4-493c-b15b-9443a5426682 Jun 16 12:33:00.632469 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:33:00.632469 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ff9e6c82-5c55-404a-a0a8-13aeb58ba94b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Returning 400 to user: Invalid volume: volume 7a1bc1ef-d211-465a-9784-42fb419181e2 is already attached to instances: ddba5ba6-d9f4-493c-b15b-9443a5426682 {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:33:00.632469 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ff9e6c82-5c55-404a-a0a8-13aeb58ba94b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "POST /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102321 Jun 16 12:33:00.632469 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 346/700] 10.222.0.45 () {60 vars in 1322 bytes} [Thu Jun 16 12:33:00 2022] POST /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 12:33:00.637181 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-cbc0472a-fc5b-4bae-848d-83cc8d00cf7b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:00.637682 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-cbc0472a-fc5b-4bae-848d-83cc8d00cf7b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9abc4b09-7cfc-47dc-b778-684eb2e331b9] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:00.643680 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cbc0472a-fc5b-4bae-848d-83cc8d00cf7b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:00.644133 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cbc0472a-fc5b-4bae-848d-83cc8d00cf7b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:00.644894 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cbc0472a-fc5b-4bae-848d-83cc8d00cf7b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:00.645341 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cbc0472a-fc5b-4bae-848d-83cc8d00cf7b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:00.671312 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-cbc0472a-fc5b-4bae-848d-83cc8d00cf7b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9abc4b09-7cfc-47dc-b778-684eb2e331b9] Going to try to terminate instance {{(pid=117607) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 12:33:00.747566 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-cbc0472a-fc5b-4bae-848d-83cc8d00cf7b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "DELETE /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9" status: 204 len: 0 microversion: 2.1 time: 0.114223 Jun 16 12:33:00.748182 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 355/701] 10.222.0.45 () {58 vars in 1238 bytes} [Thu Jun 16 12:33:00 2022] DELETE /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 12:33:00.756290 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c108d0d2-1139-473d-b78f-fb234ccff33e tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:00.756895 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c108d0d2-1139-473d-b78f-fb234ccff33e tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9abc4b09-7cfc-47dc-b778-684eb2e331b9] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:00.764472 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c108d0d2-1139-473d-b78f-fb234ccff33e tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:00.764927 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c108d0d2-1139-473d-b78f-fb234ccff33e tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:00.765696 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c108d0d2-1139-473d-b78f-fb234ccff33e tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:00.766163 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c108d0d2-1139-473d-b78f-fb234ccff33e tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:00.882097 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e1a464e6-7674-432f-a07a-75e068360350 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:00.882941 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e1a464e6-7674-432f-a07a-75e068360350 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c2472931-f1a1-4aec-963a-63a7495b733b] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:00.889438 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e1a464e6-7674-432f-a07a-75e068360350 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:00.889896 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e1a464e6-7674-432f-a07a-75e068360350 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:00.890677 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e1a464e6-7674-432f-a07a-75e068360350 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:00.891106 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e1a464e6-7674-432f-a07a-75e068360350 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:00.899606 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c108d0d2-1139-473d-b78f-fb234ccff33e tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:00.908063 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c108d0d2-1139-473d-b78f-fb234ccff33e tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9" status: 200 len: 1682 microversion: 2.1 time: 0.155559 Jun 16 12:33:00.908624 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 347/702] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:33:00 2022] GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:33:01.026217 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e1a464e6-7674-432f-a07a-75e068360350 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:01.034321 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e1a464e6-7674-432f-a07a-75e068360350 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b" status: 200 len: 1732 microversion: 2.1 time: 0.157144 Jun 16 12:33:01.034874 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 356/703] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:33:00 2022] GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:33:01.050698 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ba1e9169-7667-4b48-bdfe-4a4b06d327a2 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:01.051194 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ba1e9169-7667-4b48-bdfe-4a4b06d327a2 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c2472931-f1a1-4aec-963a-63a7495b733b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:01.058137 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ba1e9169-7667-4b48-bdfe-4a4b06d327a2 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:01.058745 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ba1e9169-7667-4b48-bdfe-4a4b06d327a2 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:01.059956 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ba1e9169-7667-4b48-bdfe-4a4b06d327a2 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:01.060073 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ba1e9169-7667-4b48-bdfe-4a4b06d327a2 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:01.142392 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ba1e9169-7667-4b48-bdfe-4a4b06d327a2 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095393 Jun 16 12:33:01.143213 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 348/704] 10.222.0.45 () {58 vars in 1274 bytes} [Thu Jun 16 12:33:01 2022] GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:33:01.927057 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-eff20b85-9cef-4ab2-9cd0-c5834bc41e94 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:01.928017 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-eff20b85-9cef-4ab2-9cd0-c5834bc41e94 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9abc4b09-7cfc-47dc-b778-684eb2e331b9] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:01.934922 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-eff20b85-9cef-4ab2-9cd0-c5834bc41e94 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:01.935367 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-eff20b85-9cef-4ab2-9cd0-c5834bc41e94 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:01.936134 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-eff20b85-9cef-4ab2-9cd0-c5834bc41e94 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:01.936574 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-eff20b85-9cef-4ab2-9cd0-c5834bc41e94 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:02.066097 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-a5299f9e-9254-42a4-951d-e644a1a70637 req-c52ce7f6-8542-4c2a-a7bb-3d7216b668d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2472931-f1a1-4aec-963a-63a7495b733b", "tag": "2aacd7af-3e65-4a78-9162-adc1a6afdbc1"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:33:02.076076 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-a5299f9e-9254-42a4-951d-e644a1a70637 req-c52ce7f6-8542-4c2a-a7bb-3d7216b668d9 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:02.076892 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-a5299f9e-9254-42a4-951d-e644a1a70637 req-c52ce7f6-8542-4c2a-a7bb-3d7216b668d9 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:02.089083 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-a5299f9e-9254-42a4-951d-e644a1a70637 req-c52ce7f6-8542-4c2a-a7bb-3d7216b668d9 service nova] Creating event network-changed:2aacd7af-3e65-4a78-9162-adc1a6afdbc1 for instance c2472931-f1a1-4aec-963a-63a7495b733b on hv-cinder-84614 Jun 16 12:33:02.094687 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-a5299f9e-9254-42a4-951d-e644a1a70637 req-c52ce7f6-8542-4c2a-a7bb-3d7216b668d9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032657 Jun 16 12:33:02.095530 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 349/705] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:33:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 12:33:02.136335 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-eff20b85-9cef-4ab2-9cd0-c5834bc41e94 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:02.139835 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:33:02.144406 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-eff20b85-9cef-4ab2-9cd0-c5834bc41e94 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9" status: 200 len: 1682 microversion: 2.1 time: 0.221606 Jun 16 12:33:02.144982 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 357/706] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:33:01 2022] GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9 => generated 1682 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:33:03.161421 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e49256ef-d0e6-4779-9dc3-2777f10f656d tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:03.162199 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e49256ef-d0e6-4779-9dc3-2777f10f656d tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9abc4b09-7cfc-47dc-b778-684eb2e331b9] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:03.169301 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e49256ef-d0e6-4779-9dc3-2777f10f656d tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:03.169757 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e49256ef-d0e6-4779-9dc3-2777f10f656d tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:03.170571 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e49256ef-d0e6-4779-9dc3-2777f10f656d tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:03.171011 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e49256ef-d0e6-4779-9dc3-2777f10f656d tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:03.387173 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e49256ef-d0e6-4779-9dc3-2777f10f656d tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:03.394613 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e49256ef-d0e6-4779-9dc3-2777f10f656d tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9" status: 200 len: 1682 microversion: 2.1 time: 0.237547 Jun 16 12:33:03.395179 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 350/707] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:33:03 2022] GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9 => generated 1682 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:33:04.134058 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-f3222fdc-3275-496d-a564-28da8518c635 req-c20531b1-3eac-4a57-95bf-5d4b0b88d278 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2472931-f1a1-4aec-963a-63a7495b733b", "tag": "2aacd7af-3e65-4a78-9162-adc1a6afdbc1"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:33:04.146888 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-f3222fdc-3275-496d-a564-28da8518c635 req-c20531b1-3eac-4a57-95bf-5d4b0b88d278 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:04.147208 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-f3222fdc-3275-496d-a564-28da8518c635 req-c20531b1-3eac-4a57-95bf-5d4b0b88d278 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:04.160719 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-f3222fdc-3275-496d-a564-28da8518c635 req-c20531b1-3eac-4a57-95bf-5d4b0b88d278 service nova] Creating event network-changed:2aacd7af-3e65-4a78-9162-adc1a6afdbc1 for instance c2472931-f1a1-4aec-963a-63a7495b733b on hv-cinder-84614 Jun 16 12:33:04.165837 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-f3222fdc-3275-496d-a564-28da8518c635 req-c20531b1-3eac-4a57-95bf-5d4b0b88d278 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035969 Jun 16 12:33:04.167356 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 358/708] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:33:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:33:04.412779 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7a35d0e8-d8c9-4275-8256-593fc00fa85b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:04.413698 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7a35d0e8-d8c9-4275-8256-593fc00fa85b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9abc4b09-7cfc-47dc-b778-684eb2e331b9] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:04.422085 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7a35d0e8-d8c9-4275-8256-593fc00fa85b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:04.422890 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7a35d0e8-d8c9-4275-8256-593fc00fa85b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:04.424359 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7a35d0e8-d8c9-4275-8256-593fc00fa85b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:04.424961 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7a35d0e8-d8c9-4275-8256-593fc00fa85b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:04.524434 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7a35d0e8-d8c9-4275-8256-593fc00fa85b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:04.544561 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7a35d0e8-d8c9-4275-8256-593fc00fa85b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9" status: 200 len: 1326 microversion: 2.1 time: 0.136217 Jun 16 12:33:04.545767 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 351/709] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:33:04 2022] GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9 => generated 1326 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:33:05.558709 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell0:SELECT=4 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:33:05.563450 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2bfb124d-365a-42da-b458-7af039d2d8e0 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:05.564159 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2bfb124d-365a-42da-b458-7af039d2d8e0 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9abc4b09-7cfc-47dc-b778-684eb2e331b9] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:05.576150 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2bfb124d-365a-42da-b458-7af039d2d8e0 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:05.576494 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2bfb124d-365a-42da-b458-7af039d2d8e0 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:05.577277 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2bfb124d-365a-42da-b458-7af039d2d8e0 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:05.577715 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2bfb124d-365a-42da-b458-7af039d2d8e0 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:05.592734 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-2bfb124d-365a-42da-b458-7af039d2d8e0 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] HTTP exception thrown: Instance 9abc4b09-7cfc-47dc-b778-684eb2e331b9 could not be found. Jun 16 12:33:05.595401 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2bfb124d-365a-42da-b458-7af039d2d8e0 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Request method failure captured: Jun 16 12:33:05.595401 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: request: GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9 HTTP/1.1 Jun 16 12:33:05.595401 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Accept: application/json Jun 16 12:33:05.595401 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jun 16 12:33:05.595401 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Connection: close Jun 16 12:33:05.595401 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jun 16 12:33:05.595401 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jun 16 12:33:05.595401 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Host: 10.222.0.45 Jun 16 12:33:05.595401 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jun 16 12:33:05.595401 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jun 16 12:33:05.595401 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABiqyGF1I7NNsn9N-NNLw8e7JwWQfFAz21t9AN_OlEcHKfvG-zVtCE3h0xqQLPiYlGgCbqHJIMx6mphLTjEkYrptZmSsukd0-SUbPj3ipfsUXouJgw4LZCCngD_KxZq-5FKd9EOmAaCBK7p8lhdHrTX3rZ5m9BxXUJmHDIk-Sxu6p9pH_c Jun 16 12:33:05.595401 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jun 16 12:33:05.595401 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jun 16 12:33:05.595401 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jun 16 12:33:05.595401 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jun 16 12:33:05.595401 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jun 16 12:33:05.595401 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jun 16 12:33:05.595401 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Id: 3fce886a9a894240a0b3bd3af94d2465 Jun 16 12:33:05.595401 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-AttachVolumeNegativeTest-1612233326 Jun 16 12:33:05.595401 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Role: member,reader Jun 16 12:33:05.595401 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Roles: member,reader Jun 16 12:33:05.597139 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3fce886a9a894240a0b3bd3af94d2465"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3fce886a9a894240a0b3bd3af94d2465"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3fce886a9a894240a0b3bd3af94d2465"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3fce886a9a894240a0b3bd3af94d2465"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Jun 16 12:33:05.597139 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-AttachVolumeNegativeTest-1612233326 Jun 16 12:33:05.597139 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant-Id: 3fce886a9a894240a0b3bd3af94d2465 Jun 16 12:33:05.597139 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1612233326 Jun 16 12:33:05.597139 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User: tempest-AttachVolumeNegativeTest-1612233326-project Jun 16 12:33:05.597139 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jun 16 12:33:05.597139 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jun 16 12:33:05.597139 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Id: ed6b630c60d640afb1325215ea27acef Jun 16 12:33:05.597139 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-AttachVolumeNegativeTest-1612233326-project Jun 16 12:33:05.597139 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: method: > Jun 16 12:33:05.597139 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: exception: Instance 9abc4b09-7cfc-47dc-b778-684eb2e331b9 could not be found. Jun 16 12:33:05.597139 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: action_args: {'id': '9abc4b09-7cfc-47dc-b778-684eb2e331b9'} Jun 16 12:33:05.598029 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:33:05.598029 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:33:05.598029 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:33:05.598029 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:33:05.598029 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:33:05.598029 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:33:05.598029 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:33:05.598029 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:33:05.598029 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:33:05.598029 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:33:05.598029 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9abc4b09-7cfc-47dc-b778-684eb2e331b9 could not be found. Jun 16 12:33:05.598029 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:33:05.598029 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:33:05.598029 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:33:05.598029 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:33:05.598029 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:33:05.598029 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:33:05.598029 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:33:05.598029 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:33:05.598029 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:33:05.599218 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:33:05.599218 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 12:33:05.599218 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 12:33:05.599218 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:33:05.599218 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:33:05.599218 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:33:05.599218 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:33:05.599218 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9abc4b09-7cfc-47dc-b778-684eb2e331b9 could not be found. Jun 16 12:33:05.599218 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:33:05.599218 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:33:05.599218 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:33:05.599218 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:33:05.599218 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:33:05.599218 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:33:05.599218 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:33:05.599218 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:33:05.599218 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9abc4b09-7cfc-47dc-b778-684eb2e331b9 could not be found. Jun 16 12:33:05.599218 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:33:05.604167 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2bfb124d-365a-42da-b458-7af039d2d8e0 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Returning 404 to user: Instance 9abc4b09-7cfc-47dc-b778-684eb2e331b9 could not be found. {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:33:05.605438 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2bfb124d-365a-42da-b458-7af039d2d8e0 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9" status: 404 len: 111 microversion: 2.1 time: 0.048795 Jun 16 12:33:05.606034 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 359/710] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:33:05 2022] GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 12:33:05.614653 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b2ead2d6-5d4a-4b03-8ad9-7986290fc639 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '.version_select at 0x7f7c721f2280>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:05.618712 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b2ead2d6-5d4a-4b03-8ad9-7986290fc639 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [b36f716a-6f77-4b86-948c-eb22c5377363] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 16 12:33:06.180567 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-5d45b46f-94c1-496e-a82c-671122e09aaa req-f4e5cac7-c2af-43ee-a3c4-04004e1d3ebb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9abc4b09-7cfc-47dc-b778-684eb2e331b9", "name": "network-vif-deleted", "tag": "00492cc8-699c-4660-9bfd-0cd1a05f4e44"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:33:06.189267 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-5d45b46f-94c1-496e-a82c-671122e09aaa req-f4e5cac7-c2af-43ee-a3c4-04004e1d3ebb service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:06.189728 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-5d45b46f-94c1-496e-a82c-671122e09aaa req-f4e5cac7-c2af-43ee-a3c4-04004e1d3ebb service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:06.201263 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-5d45b46f-94c1-496e-a82c-671122e09aaa req-f4e5cac7-c2af-43ee-a3c4-04004e1d3ebb service nova] Creating event network-vif-deleted:00492cc8-699c-4660-9bfd-0cd1a05f4e44 for instance 9abc4b09-7cfc-47dc-b778-684eb2e331b9 on hv-cinder-84614 Jun 16 12:33:06.206021 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-5d45b46f-94c1-496e-a82c-671122e09aaa req-f4e5cac7-c2af-43ee-a3c4-04004e1d3ebb service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029098 Jun 16 12:33:06.206626 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 360/711] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:33:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 12:33:06.627943 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [None req-b2ead2d6-5d4a-4b03-8ad9-7986290fc639 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [b36f716a-6f77-4b86-948c-eb22c5377363] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 42442. Jun 16 12:33:06.650878 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b2ead2d6-5d4a-4b03-8ad9-7986290fc639 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1611914687" status: 202 len: 0 microversion: 2.1 time: 1.039923 Jun 16 12:33:06.656620 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 352/712] 10.222.0.45 () {58 vars in 1220 bytes} [Thu Jun 16 12:33:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1611914687 => generated 0 bytes in 1045 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 12:33:07.573512 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-844ff22e-ded1-4602-a700-0c909da24ad5 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:07.574149 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-844ff22e-ded1-4602-a700-0c909da24ad5 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: ddba5ba6-d9f4-493c-b15b-9443a5426682] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:07.580262 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-844ff22e-ded1-4602-a700-0c909da24ad5 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:07.580713 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-844ff22e-ded1-4602-a700-0c909da24ad5 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:07.581480 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-844ff22e-ded1-4602-a700-0c909da24ad5 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:07.581945 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-844ff22e-ded1-4602-a700-0c909da24ad5 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:07.662667 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.objects.instance [None req-844ff22e-ded1-4602-a700-0c909da24ad5 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lazy-loading 'services' on Instance uuid ddba5ba6-d9f4-493c-b15b-9443a5426682 {{(pid=117607) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 12:33:07.733884 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-844ff22e-ded1-4602-a700-0c909da24ad5 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "DELETE /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682/os-volume_attachments/7a1bc1ef-d211-465a-9784-42fb419181e2" status: 202 len: 0 microversion: 2.1 time: 0.165484 Jun 16 12:33:07.734532 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 361/713] 10.222.0.45 () {58 vars in 1415 bytes} [Thu Jun 16 12:33:07 2022] DELETE /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682/os-volume_attachments/7a1bc1ef-d211-465a-9784-42fb419181e2 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 12:33:07.743979 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-02671d4d-2860-47ce-b8e2-280f041a54e0 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:07.744982 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-02671d4d-2860-47ce-b8e2-280f041a54e0 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: ddba5ba6-d9f4-493c-b15b-9443a5426682] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:07.752297 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-02671d4d-2860-47ce-b8e2-280f041a54e0 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:07.752831 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-02671d4d-2860-47ce-b8e2-280f041a54e0 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:07.753831 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-02671d4d-2860-47ce-b8e2-280f041a54e0 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:07.754300 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-02671d4d-2860-47ce-b8e2-280f041a54e0 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:07.788368 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-02671d4d-2860-47ce-b8e2-280f041a54e0 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048782 Jun 16 12:33:07.788709 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 353/714] 10.222.0.45 () {58 vars in 1301 bytes} [Thu Jun 16 12:33:07 2022] GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:33:08.801768 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6b48f55d-4385-4798-9ffd-d8dee24abc06 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:08.802805 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6b48f55d-4385-4798-9ffd-d8dee24abc06 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: ddba5ba6-d9f4-493c-b15b-9443a5426682] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:08.809194 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6b48f55d-4385-4798-9ffd-d8dee24abc06 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:08.809646 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6b48f55d-4385-4798-9ffd-d8dee24abc06 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:08.810433 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6b48f55d-4385-4798-9ffd-d8dee24abc06 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:08.811042 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6b48f55d-4385-4798-9ffd-d8dee24abc06 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:08.840193 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6b48f55d-4385-4798-9ffd-d8dee24abc06 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043129 Jun 16 12:33:08.840759 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 362/715] 10.222.0.45 () {58 vars in 1301 bytes} [Thu Jun 16 12:33:08 2022] GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:33:09.286703 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8aba583e-7290-459e-bdb6-c9e20e9b0445 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:09.287200 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8aba583e-7290-459e-bdb6-c9e20e9b0445 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:09.293124 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8aba583e-7290-459e-bdb6-c9e20e9b0445 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:09.293573 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8aba583e-7290-459e-bdb6-c9e20e9b0445 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:09.294395 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8aba583e-7290-459e-bdb6-c9e20e9b0445 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:09.294833 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8aba583e-7290-459e-bdb6-c9e20e9b0445 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:09.322581 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8aba583e-7290-459e-bdb6-c9e20e9b0445 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df/os-volume_attachments/b9aa6bfb-3275-406b-b8a2-ee31f3e96ff1" status: 200 len: 194 microversion: 2.20 time: 0.145540 Jun 16 12:33:09.323699 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 354/716] 10.222.0.45 () {60 vars in 1453 bytes} [Thu Jun 16 12:33:09 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df/os-volume_attachments/b9aa6bfb-3275-406b-b8a2-ee31f3e96ff1 => generated 194 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 12:33:09.388825 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6bfe907b-07f5-475a-9868-d90c672a368b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:09.389315 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6bfe907b-07f5-475a-9868-d90c672a368b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:09.395303 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6bfe907b-07f5-475a-9868-d90c672a368b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:09.395747 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6bfe907b-07f5-475a-9868-d90c672a368b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:09.396506 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6bfe907b-07f5-475a-9868-d90c672a368b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:09.396941 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6bfe907b-07f5-475a-9868-d90c672a368b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:09.475286 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.objects.instance [None req-6bfe907b-07f5-475a-9868-d90c672a368b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lazy-loading 'services' on Instance uuid 8528919e-1e7a-4807-9b11-ae225e65d4df {{(pid=117607) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 12:33:09.545577 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6bfe907b-07f5-475a-9868-d90c672a368b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "DELETE /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df/os-volume_attachments/b9aa6bfb-3275-406b-b8a2-ee31f3e96ff1" status: 202 len: 0 microversion: 2.20 time: 0.161128 Jun 16 12:33:09.546225 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 363/717] 10.222.0.45 () {60 vars in 1456 bytes} [Thu Jun 16 12:33:09 2022] DELETE /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df/os-volume_attachments/b9aa6bfb-3275-406b-b8a2-ee31f3e96ff1 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 12:33:09.554441 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0b57fc9b-7b8d-4850-898a-c47ff183e5ac tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:09.555445 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0b57fc9b-7b8d-4850-898a-c47ff183e5ac tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:09.561840 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0b57fc9b-7b8d-4850-898a-c47ff183e5ac tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:09.562351 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0b57fc9b-7b8d-4850-898a-c47ff183e5ac tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:09.563086 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0b57fc9b-7b8d-4850-898a-c47ff183e5ac tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:09.563526 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0b57fc9b-7b8d-4850-898a-c47ff183e5ac tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:09.588804 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:33:09.593926 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0b57fc9b-7b8d-4850-898a-c47ff183e5ac tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043395 Jun 16 12:33:09.594486 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 355/718] 10.222.0.45 () {60 vars in 1342 bytes} [Thu Jun 16 12:33:09 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 12:33:09.852691 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2ddf82e6-9ab4-42b1-a4cb-f7377a409c2d tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:09.853754 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2ddf82e6-9ab4-42b1-a4cb-f7377a409c2d tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: ddba5ba6-d9f4-493c-b15b-9443a5426682] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:09.860857 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2ddf82e6-9ab4-42b1-a4cb-f7377a409c2d tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:09.861313 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2ddf82e6-9ab4-42b1-a4cb-f7377a409c2d tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:09.862109 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2ddf82e6-9ab4-42b1-a4cb-f7377a409c2d tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:09.862548 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2ddf82e6-9ab4-42b1-a4cb-f7377a409c2d tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:09.890932 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2ddf82e6-9ab4-42b1-a4cb-f7377a409c2d tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043111 Jun 16 12:33:09.891485 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 364/719] 10.222.0.45 () {58 vars in 1301 bytes} [Thu Jun 16 12:33:09 2022] GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 12:33:09.947982 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5ab857a9-5fc0-41b3-b9d0-7683a3f4f77b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:09.948477 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5ab857a9-5fc0-41b3-b9d0-7683a3f4f77b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: ddba5ba6-d9f4-493c-b15b-9443a5426682] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:09.954352 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5ab857a9-5fc0-41b3-b9d0-7683a3f4f77b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:09.954801 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5ab857a9-5fc0-41b3-b9d0-7683a3f4f77b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:09.955558 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5ab857a9-5fc0-41b3-b9d0-7683a3f4f77b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:09.955998 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5ab857a9-5fc0-41b3-b9d0-7683a3f4f77b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:09.982733 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5ab857a9-5fc0-41b3-b9d0-7683a3f4f77b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: ddba5ba6-d9f4-493c-b15b-9443a5426682] Going to try to terminate instance {{(pid=117606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 12:33:10.056715 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5ab857a9-5fc0-41b3-b9d0-7683a3f4f77b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "DELETE /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682" status: 204 len: 0 microversion: 2.1 time: 0.112532 Jun 16 12:33:10.057281 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 356/720] 10.222.0.45 () {58 vars in 1238 bytes} [Thu Jun 16 12:33:09 2022] DELETE /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 12:33:10.066063 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4ad73b75-1655-42a0-ab93-baf2d47d14aa tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:10.066669 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4ad73b75-1655-42a0-ab93-baf2d47d14aa tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: ddba5ba6-d9f4-493c-b15b-9443a5426682] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:10.072581 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4ad73b75-1655-42a0-ab93-baf2d47d14aa tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:10.073031 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4ad73b75-1655-42a0-ab93-baf2d47d14aa tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:10.073789 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4ad73b75-1655-42a0-ab93-baf2d47d14aa tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:10.074275 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4ad73b75-1655-42a0-ab93-baf2d47d14aa tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:10.206389 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4ad73b75-1655-42a0-ab93-baf2d47d14aa tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:10.214233 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4ad73b75-1655-42a0-ab93-baf2d47d14aa tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682" status: 200 len: 1681 microversion: 2.1 time: 0.151502 Jun 16 12:33:10.214799 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 365/721] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:33:10 2022] GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:33:10.606390 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6a5f87e1-174c-478a-ba04-a3b0f76f2360 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:10.607323 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6a5f87e1-174c-478a-ba04-a3b0f76f2360 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:10.614285 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6a5f87e1-174c-478a-ba04-a3b0f76f2360 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:10.614450 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6a5f87e1-174c-478a-ba04-a3b0f76f2360 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:10.615240 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6a5f87e1-174c-478a-ba04-a3b0f76f2360 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:10.615673 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6a5f87e1-174c-478a-ba04-a3b0f76f2360 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:10.645144 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6a5f87e1-174c-478a-ba04-a3b0f76f2360 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043744 Jun 16 12:33:10.645697 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 357/722] 10.222.0.45 () {60 vars in 1342 bytes} [Thu Jun 16 12:33:10 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 12:33:11.231272 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-72e41235-cfcb-4455-92ca-d8e3de6b6e48 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:11.231888 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-72e41235-cfcb-4455-92ca-d8e3de6b6e48 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: ddba5ba6-d9f4-493c-b15b-9443a5426682] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:11.238432 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-72e41235-cfcb-4455-92ca-d8e3de6b6e48 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:11.238883 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-72e41235-cfcb-4455-92ca-d8e3de6b6e48 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:11.239643 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-72e41235-cfcb-4455-92ca-d8e3de6b6e48 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:11.240079 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-72e41235-cfcb-4455-92ca-d8e3de6b6e48 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:11.370441 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-72e41235-cfcb-4455-92ca-d8e3de6b6e48 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:11.377660 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-72e41235-cfcb-4455-92ca-d8e3de6b6e48 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682" status: 200 len: 1681 microversion: 2.1 time: 0.150307 Jun 16 12:33:11.378808 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 366/723] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:33:11 2022] GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:33:11.657930 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ea88d0c1-d91a-4492-aaf2-7f23c572e8b9 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:11.658846 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ea88d0c1-d91a-4492-aaf2-7f23c572e8b9 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:11.665553 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ea88d0c1-d91a-4492-aaf2-7f23c572e8b9 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:11.666041 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ea88d0c1-d91a-4492-aaf2-7f23c572e8b9 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:11.667457 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ea88d0c1-d91a-4492-aaf2-7f23c572e8b9 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:11.667897 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ea88d0c1-d91a-4492-aaf2-7f23c572e8b9 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:11.696023 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ea88d0c1-d91a-4492-aaf2-7f23c572e8b9 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042314 Jun 16 12:33:11.696909 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 358/724] 10.222.0.45 () {60 vars in 1342 bytes} [Thu Jun 16 12:33:11 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:33:11.755540 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-486905d0-454b-46ce-aa1f-bdbda8e36a63 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:11.756033 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-486905d0-454b-46ce-aa1f-bdbda8e36a63 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:11.762405 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-486905d0-454b-46ce-aa1f-bdbda8e36a63 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:11.762864 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-486905d0-454b-46ce-aa1f-bdbda8e36a63 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:11.763648 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-486905d0-454b-46ce-aa1f-bdbda8e36a63 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:11.764091 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-486905d0-454b-46ce-aa1f-bdbda8e36a63 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:11.790371 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-486905d0-454b-46ce-aa1f-bdbda8e36a63 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Going to try to terminate instance {{(pid=117607) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 12:33:11.874925 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-486905d0-454b-46ce-aa1f-bdbda8e36a63 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "DELETE /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 204 len: 0 microversion: 2.20 time: 0.122859 Jun 16 12:33:11.878885 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 367/725] 10.222.0.45 () {60 vars in 1279 bytes} [Thu Jun 16 12:33:11 2022] DELETE /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 12:33:11.884423 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0a06b44e-079e-4158-b531-f854842f28b0 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:11.885040 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0a06b44e-079e-4158-b531-f854842f28b0 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:11.892653 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0a06b44e-079e-4158-b531-f854842f28b0 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:11.893102 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0a06b44e-079e-4158-b531-f854842f28b0 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:11.894102 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0a06b44e-079e-4158-b531-f854842f28b0 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:11.894660 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0a06b44e-079e-4158-b531-f854842f28b0 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:12.034355 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0a06b44e-079e-4158-b531-f854842f28b0 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:12.043111 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0a06b44e-079e-4158-b531-f854842f28b0 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:12.044859 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0a06b44e-079e-4158-b531-f854842f28b0 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:12.046218 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0a06b44e-079e-4158-b531-f854842f28b0 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1721 microversion: 2.20 time: 0.165961 Jun 16 12:33:12.046920 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 359/726] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:33:11 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:33:12.397016 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-fa0f66a1-e4b1-4e43-aa79-f1439e0b304b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:12.397698 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-fa0f66a1-e4b1-4e43-aa79-f1439e0b304b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: ddba5ba6-d9f4-493c-b15b-9443a5426682] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:12.405071 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fa0f66a1-e4b1-4e43-aa79-f1439e0b304b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:12.405514 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fa0f66a1-e4b1-4e43-aa79-f1439e0b304b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:12.406955 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fa0f66a1-e4b1-4e43-aa79-f1439e0b304b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:12.407388 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fa0f66a1-e4b1-4e43-aa79-f1439e0b304b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:12.483544 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-fa0f66a1-e4b1-4e43-aa79-f1439e0b304b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:12.492011 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-fa0f66a1-e4b1-4e43-aa79-f1439e0b304b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682" status: 200 len: 1614 microversion: 2.1 time: 0.100534 Jun 16 12:33:12.498582 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 368/727] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:33:12 2022] GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682 => generated 1614 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:33:12.504322 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-ae26a4c0-a319-4d3a-91de-84cb093b2944 req-033d8d47-335c-4326-8c76-b45a3d3e11ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddba5ba6-d9f4-493c-b15b-9443a5426682", "name": "network-vif-deleted", "tag": "80765d24-d4d2-42f5-b6b1-6bb0e8d83b1d"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:33:12.512490 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-ae26a4c0-a319-4d3a-91de-84cb093b2944 req-033d8d47-335c-4326-8c76-b45a3d3e11ee service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:12.512933 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-ae26a4c0-a319-4d3a-91de-84cb093b2944 req-033d8d47-335c-4326-8c76-b45a3d3e11ee service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:12.523861 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-ae26a4c0-a319-4d3a-91de-84cb093b2944 req-033d8d47-335c-4326-8c76-b45a3d3e11ee service nova] Creating event network-vif-deleted:80765d24-d4d2-42f5-b6b1-6bb0e8d83b1d for instance ddba5ba6-d9f4-493c-b15b-9443a5426682 on hv-cinder-84614 Jun 16 12:33:12.529086 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-ae26a4c0-a319-4d3a-91de-84cb093b2944 req-033d8d47-335c-4326-8c76-b45a3d3e11ee service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091730 Jun 16 12:33:12.529672 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 360/728] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:33:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 12:33:13.064488 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-480bfbcb-61f8-4eaf-8df4-ab1c149107a3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:13.065097 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-480bfbcb-61f8-4eaf-8df4-ab1c149107a3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:13.071157 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-480bfbcb-61f8-4eaf-8df4-ab1c149107a3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:13.071612 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-480bfbcb-61f8-4eaf-8df4-ab1c149107a3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:13.072379 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-480bfbcb-61f8-4eaf-8df4-ab1c149107a3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:13.073472 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-480bfbcb-61f8-4eaf-8df4-ab1c149107a3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:13.215135 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-480bfbcb-61f8-4eaf-8df4-ab1c149107a3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:13.224221 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-480bfbcb-61f8-4eaf-8df4-ab1c149107a3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:13.225731 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-480bfbcb-61f8-4eaf-8df4-ab1c149107a3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:13.226961 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-480bfbcb-61f8-4eaf-8df4-ab1c149107a3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1721 microversion: 2.20 time: 0.166352 Jun 16 12:33:13.227532 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 369/729] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:33:13 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:33:13.511441 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2f9550f8-30e0-4238-8d38-231e2abbdbdf tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:13.512052 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2f9550f8-30e0-4238-8d38-231e2abbdbdf tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: ddba5ba6-d9f4-493c-b15b-9443a5426682] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:13.518283 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2f9550f8-30e0-4238-8d38-231e2abbdbdf tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:13.518727 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2f9550f8-30e0-4238-8d38-231e2abbdbdf tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:13.519474 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2f9550f8-30e0-4238-8d38-231e2abbdbdf tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:13.519908 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2f9550f8-30e0-4238-8d38-231e2abbdbdf tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:13.552105 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2f9550f8-30e0-4238-8d38-231e2abbdbdf tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:13.552544 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2f9550f8-30e0-4238-8d38-231e2abbdbdf tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:13.553005 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.objects.instance [None req-2f9550f8-30e0-4238-8d38-231e2abbdbdf tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lazy-loading 'fault' on Instance uuid ddba5ba6-d9f4-493c-b15b-9443a5426682 {{(pid=117606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 12:33:13.593675 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2f9550f8-30e0-4238-8d38-231e2abbdbdf tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:13.601146 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2f9550f8-30e0-4238-8d38-231e2abbdbdf tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682" status: 200 len: 1330 microversion: 2.1 time: 0.095171 Jun 16 12:33:13.601711 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 361/730] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:33:13 2022] GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682 => generated 1330 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:33:14.246487 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-9e13e56a-6f4b-4733-9d9c-29aebcc3f0be tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:14.247969 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-9e13e56a-6f4b-4733-9d9c-29aebcc3f0be tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:14.255588 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9e13e56a-6f4b-4733-9d9c-29aebcc3f0be tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:14.256121 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9e13e56a-6f4b-4733-9d9c-29aebcc3f0be tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:14.256990 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9e13e56a-6f4b-4733-9d9c-29aebcc3f0be tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:14.257485 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9e13e56a-6f4b-4733-9d9c-29aebcc3f0be tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:14.395287 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-9e13e56a-6f4b-4733-9d9c-29aebcc3f0be tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:14.404489 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-9e13e56a-6f4b-4733-9d9c-29aebcc3f0be tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:14.406341 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-9e13e56a-6f4b-4733-9d9c-29aebcc3f0be tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:14.407538 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-9e13e56a-6f4b-4733-9d9c-29aebcc3f0be tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1721 microversion: 2.20 time: 0.165439 Jun 16 12:33:14.408108 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 370/731] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:33:14 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:33:14.618412 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-bec18a04-e836-4311-bad4-e2dbadb31cb0 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:14.620318 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-bec18a04-e836-4311-bad4-e2dbadb31cb0 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: ddba5ba6-d9f4-493c-b15b-9443a5426682] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:14.623529 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=58,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:33:14.629354 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bec18a04-e836-4311-bad4-e2dbadb31cb0 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:14.629789 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bec18a04-e836-4311-bad4-e2dbadb31cb0 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:14.630583 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bec18a04-e836-4311-bad4-e2dbadb31cb0 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:14.631014 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bec18a04-e836-4311-bad4-e2dbadb31cb0 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:14.646684 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-bec18a04-e836-4311-bad4-e2dbadb31cb0 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] HTTP exception thrown: Instance ddba5ba6-d9f4-493c-b15b-9443a5426682 could not be found. Jun 16 12:33:14.648299 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-bec18a04-e836-4311-bad4-e2dbadb31cb0 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Request method failure captured: Jun 16 12:33:14.648299 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: request: GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682 HTTP/1.1 Jun 16 12:33:14.648299 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 16 12:33:14.648299 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 16 12:33:14.648299 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Connection: close Jun 16 12:33:14.648299 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 16 12:33:14.648299 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 16 12:33:14.648299 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Host: 10.222.0.45 Jun 16 12:33:14.648299 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 16 12:33:14.648299 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 16 12:33:14.648299 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABiqyGF1I7NNsn9N-NNLw8e7JwWQfFAz21t9AN_OlEcHKfvG-zVtCE3h0xqQLPiYlGgCbqHJIMx6mphLTjEkYrptZmSsukd0-SUbPj3ipfsUXouJgw4LZCCngD_KxZq-5FKd9EOmAaCBK7p8lhdHrTX3rZ5m9BxXUJmHDIk-Sxu6p9pH_c Jun 16 12:33:14.648299 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 16 12:33:14.648299 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 16 12:33:14.648299 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 16 12:33:14.648299 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 16 12:33:14.648299 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 16 12:33:14.648299 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 16 12:33:14.648299 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Id: 3fce886a9a894240a0b3bd3af94d2465 Jun 16 12:33:14.648299 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-AttachVolumeNegativeTest-1612233326 Jun 16 12:33:14.648299 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 16 12:33:14.648299 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 16 12:33:14.649938 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3fce886a9a894240a0b3bd3af94d2465"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3fce886a9a894240a0b3bd3af94d2465"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3fce886a9a894240a0b3bd3af94d2465"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3fce886a9a894240a0b3bd3af94d2465"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Jun 16 12:33:14.649938 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-AttachVolumeNegativeTest-1612233326 Jun 16 12:33:14.649938 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 3fce886a9a894240a0b3bd3af94d2465 Jun 16 12:33:14.649938 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1612233326 Jun 16 12:33:14.649938 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User: tempest-AttachVolumeNegativeTest-1612233326-project Jun 16 12:33:14.649938 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 16 12:33:14.649938 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 16 12:33:14.649938 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Id: ed6b630c60d640afb1325215ea27acef Jun 16 12:33:14.649938 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-AttachVolumeNegativeTest-1612233326-project Jun 16 12:33:14.649938 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: method: > Jun 16 12:33:14.649938 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: exception: Instance ddba5ba6-d9f4-493c-b15b-9443a5426682 could not be found. Jun 16 12:33:14.649938 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: action_args: {'id': 'ddba5ba6-d9f4-493c-b15b-9443a5426682'} Jun 16 12:33:14.650819 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:33:14.650819 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:33:14.650819 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:33:14.650819 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:33:14.650819 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:33:14.650819 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:33:14.650819 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:33:14.650819 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:33:14.650819 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:33:14.650819 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:33:14.650819 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddba5ba6-d9f4-493c-b15b-9443a5426682 could not be found. Jun 16 12:33:14.650819 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:33:14.650819 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:33:14.650819 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:33:14.650819 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:33:14.650819 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:33:14.650819 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:33:14.650819 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:33:14.650819 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:33:14.650819 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:33:14.652381 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:33:14.652381 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 12:33:14.652381 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 12:33:14.652381 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:33:14.652381 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:33:14.652381 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:33:14.652381 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:33:14.652381 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddba5ba6-d9f4-493c-b15b-9443a5426682 could not be found. Jun 16 12:33:14.652381 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:33:14.652381 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:33:14.652381 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:33:14.652381 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:33:14.652381 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:33:14.652381 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:33:14.652381 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:33:14.652381 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:33:14.652381 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddba5ba6-d9f4-493c-b15b-9443a5426682 could not be found. Jun 16 12:33:14.652381 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:33:14.653632 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-bec18a04-e836-4311-bad4-e2dbadb31cb0 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Returning 404 to user: Instance ddba5ba6-d9f4-493c-b15b-9443a5426682 could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:33:14.653632 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-bec18a04-e836-4311-bad4-e2dbadb31cb0 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682" status: 404 len: 111 microversion: 2.1 time: 0.035228 Jun 16 12:33:14.653632 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 362/732] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:33:14 2022] GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 12:33:14.659027 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-aef03b58-5de5-484f-b1bb-1d836d83001c tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '.version_select at 0x7f7c71f56820>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:14.677967 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-aef03b58-5de5-484f-b1bb-1d836d83001c tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-309975216" status: 202 len: 0 microversion: 2.1 time: 0.022940 Jun 16 12:33:14.678668 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 371/733] 10.222.0.45 () {58 vars in 1217 bytes} [Thu Jun 16 12:33:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-309975216 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 12:33:15.031232 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-788d4d84-7096-47fc-b892-7573cf73d650 req-e837bceb-2df9-470c-b125-7ca97a02beed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8528919e-1e7a-4807-9b11-ae225e65d4df", "name": "network-vif-deleted", "tag": "ee66a439-1483-44c8-a66e-9b4920bb00e9"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:33:15.058174 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-788d4d84-7096-47fc-b892-7573cf73d650 req-e837bceb-2df9-470c-b125-7ca97a02beed service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:15.059087 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-788d4d84-7096-47fc-b892-7573cf73d650 req-e837bceb-2df9-470c-b125-7ca97a02beed service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:15.081594 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-788d4d84-7096-47fc-b892-7573cf73d650 req-e837bceb-2df9-470c-b125-7ca97a02beed service nova] Creating event network-vif-deleted:ee66a439-1483-44c8-a66e-9b4920bb00e9 for instance 8528919e-1e7a-4807-9b11-ae225e65d4df on hv-cinder-84614 Jun 16 12:33:15.107473 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-788d4d84-7096-47fc-b892-7573cf73d650 req-e837bceb-2df9-470c-b125-7ca97a02beed service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085620 Jun 16 12:33:15.110683 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 363/734] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:33:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:33:15.398555 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-cac74e77-955e-4f88-a825-2e2cf7d3c787 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Action: 'create', calling method: .version_select at 0x7f7c720a40d0>, body: {"keypair": {"name": "tempest-keypair-106645397", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBByEW8DEwcYcuxR9D6HatpdaFWUfAnHqdCrJWU1cyD6srteZiHoRosb2rIJsBkS1m+K6QYBnveS++4vc3IKPzCDPh09uchVeA8hxBJ3q8zmWndvZzY/PGGIjBwPfL5xBbA=="}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:33:15.403134 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=1,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:33:15.418132 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-cac74e77-955e-4f88-a825-2e2cf7d3c787 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Getting quotas for project 3fce886a9a894240a0b3bd3af94d2465. Resources: {'key_pairs'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 12:33:15.422418 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-cac74e77-955e-4f88-a825-2e2cf7d3c787 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Getting quotas for user ed6b630c60d640afb1325215ea27acef and project 3fce886a9a894240a0b3bd3af94d2465. Resources: {'key_pairs'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 12:33:15.426880 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c71c583b-f434-417b-9d59-addba3d40276 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:15.427596 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c71c583b-f434-417b-9d59-addba3d40276 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:15.436214 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c71c583b-f434-417b-9d59-addba3d40276 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:15.436835 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c71c583b-f434-417b-9d59-addba3d40276 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:15.437792 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c71c583b-f434-417b-9d59-addba3d40276 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:15.438402 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c71c583b-f434-417b-9d59-addba3d40276 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:15.452417 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-cac74e77-955e-4f88-a825-2e2cf7d3c787 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.058212 Jun 16 12:33:15.460075 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 372/735] 10.222.0.45 () {60 vars in 1158 bytes} [Thu Jun 16 12:33:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:33:15.486706 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c71c583b-f434-417b-9d59-addba3d40276 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:15.487349 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c71c583b-f434-417b-9d59-addba3d40276 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:15.487962 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.objects.instance [None req-c71c583b-f434-417b-9d59-addba3d40276 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lazy-loading 'fault' on Instance uuid 8528919e-1e7a-4807-9b11-ae225e65d4df {{(pid=117606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 12:33:15.543427 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c71c583b-f434-417b-9d59-addba3d40276 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:15.571016 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c71c583b-f434-417b-9d59-addba3d40276 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:15.573751 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c71c583b-f434-417b-9d59-addba3d40276 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:15.575236 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c71c583b-f434-417b-9d59-addba3d40276 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 200 len: 1372 microversion: 2.20 time: 0.152815 Jun 16 12:33:15.575796 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 364/736] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:33:15 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 12:33:16.594418 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ecdea411-e004-4ca7-9a7c-0524a0bf6de3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:16.595030 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ecdea411-e004-4ca7-9a7c-0524a0bf6de3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:16.601277 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ecdea411-e004-4ca7-9a7c-0524a0bf6de3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:16.601798 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ecdea411-e004-4ca7-9a7c-0524a0bf6de3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:16.602605 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ecdea411-e004-4ca7-9a7c-0524a0bf6de3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:16.603181 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ecdea411-e004-4ca7-9a7c-0524a0bf6de3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:16.616708 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-ecdea411-e004-4ca7-9a7c-0524a0bf6de3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] HTTP exception thrown: Instance 8528919e-1e7a-4807-9b11-ae225e65d4df could not be found. Jun 16 12:33:16.618397 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ecdea411-e004-4ca7-9a7c-0524a0bf6de3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Request method failure captured: Jun 16 12:33:16.618397 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: request: GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df HTTP/1.1 Jun 16 12:33:16.618397 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Accept: application/json Jun 16 12:33:16.618397 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jun 16 12:33:16.618397 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Connection: close Jun 16 12:33:16.618397 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jun 16 12:33:16.618397 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jun 16 12:33:16.618397 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Host: 10.222.0.45 Jun 16 12:33:16.618397 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jun 16 12:33:16.618397 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jun 16 12:33:16.618397 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABiqyGF45WJthPoje2fm_CkoZIB6HenyTxmCcWuoWEwLwDmGmYSmBO0DdCi7iivh_AJxLzcemhDXmPR5vvH45qL8qC_XPuYlBrA1x8oGGXWiuPkoeqCyenYIUhaTgwioAG2Eo7jiMG6peQL1gAPmaq76kMQ_e0BLllLSBNLTOsXKFAP7II Jun 16 12:33:16.618397 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jun 16 12:33:16.618397 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jun 16 12:33:16.618397 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jun 16 12:33:16.618397 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jun 16 12:33:16.618397 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 12:33:16.618397 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jun 16 12:33:16.618397 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jun 16 12:33:16.618397 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Id: 501ea87534094acaa1b0a50b01901cac Jun 16 12:33:16.618397 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-551653103 Jun 16 12:33:16.618397 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Role: member,reader Jun 16 12:33:16.618397 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Roles: member,reader Jun 16 12:33:16.620896 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/501ea87534094acaa1b0a50b01901cac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/501ea87534094acaa1b0a50b01901cac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_501ea87534094acaa1b0a50b01901cac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/501ea87534094acaa1b0a50b01901cac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Jun 16 12:33:16.620896 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-AttachVolumeShelveTestJSON-551653103 Jun 16 12:33:16.620896 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant-Id: 501ea87534094acaa1b0a50b01901cac Jun 16 12:33:16.620896 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-551653103 Jun 16 12:33:16.620896 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User: tempest-AttachVolumeShelveTestJSON-551653103-project Jun 16 12:33:16.620896 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jun 16 12:33:16.620896 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jun 16 12:33:16.620896 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Id: cb370edc0f094c04904eb093a9eb0a42 Jun 16 12:33:16.620896 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-AttachVolumeShelveTestJSON-551653103-project Jun 16 12:33:16.620896 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: method: > Jun 16 12:33:16.620896 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: exception: Instance 8528919e-1e7a-4807-9b11-ae225e65d4df could not be found. Jun 16 12:33:16.620896 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: action_args: {'id': '8528919e-1e7a-4807-9b11-ae225e65d4df'} Jun 16 12:33:16.621917 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:33:16.621917 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:33:16.621917 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:33:16.621917 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:33:16.621917 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:33:16.621917 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:33:16.621917 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:33:16.621917 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:33:16.621917 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:33:16.621917 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:33:16.621917 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8528919e-1e7a-4807-9b11-ae225e65d4df could not be found. Jun 16 12:33:16.621917 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:33:16.621917 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:33:16.621917 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:33:16.621917 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:33:16.621917 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:33:16.621917 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:33:16.621917 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:33:16.621917 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:33:16.621917 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:33:16.623103 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:33:16.623103 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 12:33:16.623103 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 12:33:16.623103 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:33:16.623103 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:33:16.623103 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:33:16.623103 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:33:16.623103 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8528919e-1e7a-4807-9b11-ae225e65d4df could not be found. Jun 16 12:33:16.623103 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:33:16.623103 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:33:16.623103 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:33:16.623103 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:33:16.623103 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:33:16.623103 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:33:16.623103 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:33:16.623103 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:33:16.623103 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8528919e-1e7a-4807-9b11-ae225e65d4df could not be found. Jun 16 12:33:16.623103 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:33:16.624146 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ecdea411-e004-4ca7-9a7c-0524a0bf6de3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Returning 404 to user: Instance 8528919e-1e7a-4807-9b11-ae225e65d4df could not be found. {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:33:16.624146 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ecdea411-e004-4ca7-9a7c-0524a0bf6de3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 404 len: 111 microversion: 2.20 time: 0.029881 Jun 16 12:33:16.624146 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 373/737] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:33:16 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 12:33:16.630059 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-baae2131-ff9e-472a-b4cc-e8eacd050903 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '.version_select at 0x7f7c722e14c0>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:16.647840 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-baae2131-ff9e-472a-b4cc-e8eacd050903 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1163063130" status: 204 len: 0 microversion: 2.20 time: 0.022120 Jun 16 12:33:16.648405 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 365/738] 10.222.0.45 () {60 vars in 1261 bytes} [Thu Jun 16 12:33:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1163063130 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 12:33:16.756735 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a7b0f105-40cb-472d-827b-4df750eddccb tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-110375519", "imageRef": "c736a2d2-9d0d-41ec-b9fc-971428b0ff7a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "151a2bee-6229-46e8-95f9-7544fde552a8"}], "security_groups": [{"name": "tempest-securitygroup--1722306035"}], "key_name": "tempest-keypair-106645397", "user_data": "}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:33:16.954542 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.network.neutron [None req-a7b0f105-40cb-472d-827b-4df750eddccb tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] validate_networks() for [('151a2bee-6229-46e8-95f9-7544fde552a8', None, None, None, None, None)] {{(pid=117607) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 12:33:17.543190 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b5041d28-e06c-4309-8f92-25cc0e6e4002 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Action: 'create', calling method: .version_select at 0x7f7c7218c160>, body: {"keypair": {"name": "tempest-keypair-1271708607", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDXjkSc1V6nRaowStrCECPTP4hiPIsjTES2/48tc/Dxq/9E4OKlKJR1pD3MCnU9g4knTbU+XlRZl8KumIHkah5e06lOHbm7gZssxAT+g2uxrMgNwli7D8XOm6iGBqAUzJg=="}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:33:17.558040 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-b5041d28-e06c-4309-8f92-25cc0e6e4002 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Getting quotas for project 501ea87534094acaa1b0a50b01901cac. Resources: {'key_pairs'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 12:33:17.561918 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-b5041d28-e06c-4309-8f92-25cc0e6e4002 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Getting quotas for user cb370edc0f094c04904eb093a9eb0a42 and project 501ea87534094acaa1b0a50b01901cac. Resources: {'key_pairs'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 12:33:17.586055 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b5041d28-e06c-4309-8f92-25cc0e6e4002 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.047118 Jun 16 12:33:17.586830 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 366/739] 10.222.0.45 () {62 vars in 1199 bytes} [Thu Jun 16 12:33:17 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 48 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jun 16 12:33:17.606365 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-a7b0f105-40cb-472d-827b-4df750eddccb tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Flavor limits 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 12:33:17.606833 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-a7b0f105-40cb-472d-827b-4df750eddccb tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Image limits 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 12:33:17.607256 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-a7b0f105-40cb-472d-827b-4df750eddccb tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Flavor pref 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 12:33:17.607664 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-a7b0f105-40cb-472d-827b-4df750eddccb tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Image pref 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 12:33:17.608075 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-a7b0f105-40cb-472d-827b-4df750eddccb tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 12:33:17.616895 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a7b0f105-40cb-472d-827b-4df750eddccb tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:17.617430 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a7b0f105-40cb-472d-827b-4df750eddccb tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:17.618174 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a7b0f105-40cb-472d-827b-4df750eddccb tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:17.618607 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a7b0f105-40cb-472d-827b-4df750eddccb tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:17.635754 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-a7b0f105-40cb-472d-827b-4df750eddccb tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Getting quotas for project 3fce886a9a894240a0b3bd3af94d2465. Resources: {'instances', 'cores', 'ram'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 12:33:17.639826 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-a7b0f105-40cb-472d-827b-4df750eddccb tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Getting quotas for user ed6b630c60d640afb1325215ea27acef and project 3fce886a9a894240a0b3bd3af94d2465. Resources: {'instances', 'cores', 'ram'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 12:33:17.651240 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a7b0f105-40cb-472d-827b-4df750eddccb tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Going to run 1 instances... {{(pid=117607) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 12:33:17.653499 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a7b0f105-40cb-472d-827b-4df750eddccb tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9fe7b62b-623e-46c4-9b2d-2c744c2b3512] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c736a2d2-9d0d-41ec-b9fc-971428b0ff7a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117607) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 12:33:17.698693 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a7b0f105-40cb-472d-827b-4df750eddccb tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.946285 Jun 16 12:33:17.699855 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 374/740] 10.222.0.45 () {60 vars in 1146 bytes} [Thu Jun 16 12:33:16 2022] POST /compute/v2.1/servers => generated 402 bytes in 948 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 12:33:17.709419 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-411227ca-28f9-4051-b7ab-53d7f378a836 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:17.711046 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-411227ca-28f9-4051-b7ab-53d7f378a836 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9fe7b62b-623e-46c4-9b2d-2c744c2b3512] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:17.766599 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-411227ca-28f9-4051-b7ab-53d7f378a836 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:17.773252 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-411227ca-28f9-4051-b7ab-53d7f378a836 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/9fe7b62b-623e-46c4-9b2d-2c744c2b3512" status: 200 len: 1240 microversion: 2.1 time: 0.067794 Jun 16 12:33:17.773810 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 367/741] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:33:17 2022] GET /compute/v2.1/servers/9fe7b62b-623e-46c4-9b2d-2c744c2b3512 => generated 1240 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:33:18.273766 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5c9281d1-d73c-4886-b405-177745589388 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1893572516", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1163784128", "security_groups": [{"name": "tempest-secgroup-smoke-1205076348"}], "networks": [{"uuid": "df109a35-a0a7-40d9-acdb-8d65c87248f3"}], "block_device_mapping_v2": [{"uuid": "96d9bf38-060b-4b25-885f-bfbe3685d93f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:33:18.387568 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.network.neutron [None req-5c9281d1-d73c-4886-b405-177745589388 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] validate_networks() for [('df109a35-a0a7-40d9-acdb-8d65c87248f3', None, None, None, None, None)] {{(pid=117607) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 12:33:18.774807 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-5c9281d1-d73c-4886-b405-177745589388 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Flavor limits 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 12:33:18.774807 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-5c9281d1-d73c-4886-b405-177745589388 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Image limits 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 12:33:18.779051 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-5c9281d1-d73c-4886-b405-177745589388 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Flavor pref 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 12:33:18.779578 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-5c9281d1-d73c-4886-b405-177745589388 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Image pref 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 12:33:18.780108 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-5c9281d1-d73c-4886-b405-177745589388 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 12:33:18.790350 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8d8173b1-87f9-446f-b72e-54494cc84661 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:18.791635 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8d8173b1-87f9-446f-b72e-54494cc84661 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9fe7b62b-623e-46c4-9b2d-2c744c2b3512] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:18.803828 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5c9281d1-d73c-4886-b405-177745589388 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:18.804349 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5c9281d1-d73c-4886-b405-177745589388 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:18.805327 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5c9281d1-d73c-4886-b405-177745589388 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:18.805983 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5c9281d1-d73c-4886-b405-177745589388 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:18.826136 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-5c9281d1-d73c-4886-b405-177745589388 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Getting quotas for project 9cf2d3eca81148afa04159506decfdce. Resources: {'instances', 'cores', 'ram'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 12:33:18.830234 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-5c9281d1-d73c-4886-b405-177745589388 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Getting quotas for user 46f18557a45846c1bd9075f8a0717652 and project 9cf2d3eca81148afa04159506decfdce. Resources: {'instances', 'cores', 'ram'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 12:33:18.860166 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8d8173b1-87f9-446f-b72e-54494cc84661 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:18.867755 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8d8173b1-87f9-446f-b72e-54494cc84661 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/9fe7b62b-623e-46c4-9b2d-2c744c2b3512" status: 200 len: 1240 microversion: 2.1 time: 0.081079 Jun 16 12:33:18.869152 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 368/742] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:33:18 2022] GET /compute/v2.1/servers/9fe7b62b-623e-46c4-9b2d-2c744c2b3512 => generated 1240 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:33:18.877048 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e1614a12-4215-46c8-a8cd-6c43d597f537 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1781149819", "imageRef": "c736a2d2-9d0d-41ec-b9fc-971428b0ff7a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2ef9c4f6-367f-48f5-a387-6aeb59709145"}], "security_groups": [{"name": "tempest-securitygroup--2076330336"}], "key_name": "tempest-keypair-1271708607", "user_data": "}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:33:18.901345 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5c9281d1-d73c-4886-b405-177745589388 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Going to run 1 instances... {{(pid=117607) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 12:33:18.903331 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5c9281d1-d73c-4886-b405-177745589388 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] [instance: 198edd63-e22e-42ca-8c37-89b4f87bab60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='96d9bf38-060b-4b25-885f-bfbe3685d93f',volume_size=None,volume_type=None)] {{(pid=117607) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 12:33:18.992723 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.network.neutron [None req-e1614a12-4215-46c8-a8cd-6c43d597f537 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] validate_networks() for [('2ef9c4f6-367f-48f5-a387-6aeb59709145', None, None, None, None, None)] {{(pid=117606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 12:33:19.045052 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5c9281d1-d73c-4886-b405-177745589388 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.775125 Jun 16 12:33:19.045883 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 375/743] 10.222.0.45 () {60 vars in 1146 bytes} [Thu Jun 16 12:33:18 2022] POST /compute/v2.1/servers => generated 406 bytes in 776 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 12:33:19.055189 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-eebe2cd2-84f3-4a60-ad87-dd5a931febf9 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:19.055802 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-eebe2cd2-84f3-4a60-ad87-dd5a931febf9 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] [instance: 198edd63-e22e-42ca-8c37-89b4f87bab60] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:19.118595 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-eebe2cd2-84f3-4a60-ad87-dd5a931febf9 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f18557a45846c1bd9075f8a0717652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf2d3eca81148afa04159506decfdce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:19.128410 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-eebe2cd2-84f3-4a60-ad87-dd5a931febf9 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] 10.222.0.45 "GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60" status: 200 len: 1089 microversion: 2.1 time: 0.076808 Jun 16 12:33:19.129061 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 376/744] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:33:19 2022] GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60 => generated 1089 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:33:19.463055 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-e1614a12-4215-46c8-a8cd-6c43d597f537 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Flavor limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 12:33:19.463957 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-e1614a12-4215-46c8-a8cd-6c43d597f537 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Image limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 12:33:19.464166 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-e1614a12-4215-46c8-a8cd-6c43d597f537 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Flavor pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 12:33:19.464650 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-e1614a12-4215-46c8-a8cd-6c43d597f537 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Image pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 12:33:19.465172 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-e1614a12-4215-46c8-a8cd-6c43d597f537 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 12:33:19.474511 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e1614a12-4215-46c8-a8cd-6c43d597f537 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:19.474985 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e1614a12-4215-46c8-a8cd-6c43d597f537 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:19.475811 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e1614a12-4215-46c8-a8cd-6c43d597f537 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:19.476274 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e1614a12-4215-46c8-a8cd-6c43d597f537 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:19.493233 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-e1614a12-4215-46c8-a8cd-6c43d597f537 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Getting quotas for project 501ea87534094acaa1b0a50b01901cac. Resources: {'instances', 'cores', 'ram'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 12:33:19.498068 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-e1614a12-4215-46c8-a8cd-6c43d597f537 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Getting quotas for user cb370edc0f094c04904eb093a9eb0a42 and project 501ea87534094acaa1b0a50b01901cac. Resources: {'instances', 'cores', 'ram'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 12:33:19.509602 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e1614a12-4215-46c8-a8cd-6c43d597f537 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Going to run 1 instances... {{(pid=117606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 12:33:19.512012 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e1614a12-4215-46c8-a8cd-6c43d597f537 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c736a2d2-9d0d-41ec-b9fc-971428b0ff7a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 12:33:19.555664 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e1614a12-4215-46c8-a8cd-6c43d597f537 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [5d68919a-88e6-421b-85a3-c380aa45cf1e] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 16 12:33:19.885382 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0ed96766-0828-4e57-9a47-d9da1d6aed92 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:19.885952 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0ed96766-0828-4e57-9a47-d9da1d6aed92 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9fe7b62b-623e-46c4-9b2d-2c744c2b3512] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:19.937779 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0ed96766-0828-4e57-9a47-d9da1d6aed92 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:19.944899 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0ed96766-0828-4e57-9a47-d9da1d6aed92 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/9fe7b62b-623e-46c4-9b2d-2c744c2b3512" status: 200 len: 1240 microversion: 2.1 time: 0.063492 Jun 16 12:33:19.945449 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 377/745] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:33:19 2022] GET /compute/v2.1/servers/9fe7b62b-623e-46c4-9b2d-2c744c2b3512 => generated 1240 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:33:20.145388 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-75fe8a6c-c9e5-4567-8913-3ccbb2da1dbd tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:20.146022 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-75fe8a6c-c9e5-4567-8913-3ccbb2da1dbd tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] [instance: 198edd63-e22e-42ca-8c37-89b4f87bab60] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:20.152259 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-75fe8a6c-c9e5-4567-8913-3ccbb2da1dbd tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:20.152709 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-75fe8a6c-c9e5-4567-8913-3ccbb2da1dbd tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:20.153511 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-75fe8a6c-c9e5-4567-8913-3ccbb2da1dbd tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:20.153973 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-75fe8a6c-c9e5-4567-8913-3ccbb2da1dbd tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:20.220592 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-75fe8a6c-c9e5-4567-8913-3ccbb2da1dbd tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f18557a45846c1bd9075f8a0717652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf2d3eca81148afa04159506decfdce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:20.230042 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-75fe8a6c-c9e5-4567-8913-3ccbb2da1dbd tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] 10.222.0.45 "GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60" status: 200 len: 1205 microversion: 2.1 time: 0.088689 Jun 16 12:33:20.230756 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 378/746] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:33:20 2022] GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60 => generated 1205 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:33:20.563056 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [None req-e1614a12-4215-46c8-a8cd-6c43d597f537 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [5d68919a-88e6-421b-85a3-c380aa45cf1e] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 42662. Jun 16 12:33:20.567914 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e1614a12-4215-46c8-a8cd-6c43d597f537 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.696903 Jun 16 12:33:20.568579 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 369/747] 10.222.0.45 () {62 vars in 1187 bytes} [Thu Jun 16 12:33:18 2022] POST /compute/v2.1/servers => generated 402 bytes in 1699 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 16 12:33:20.579487 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2c4a0b6b-9c03-4e84-9aea-337cc7a33bb1 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:20.580339 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2c4a0b6b-9c03-4e84-9aea-337cc7a33bb1 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:20.658298 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2c4a0b6b-9c03-4e84-9aea-337cc7a33bb1 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:20.665597 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2c4a0b6b-9c03-4e84-9aea-337cc7a33bb1 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:20.667824 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2c4a0b6b-9c03-4e84-9aea-337cc7a33bb1 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:20.669296 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2c4a0b6b-9c03-4e84-9aea-337cc7a33bb1 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 200 len: 1282 microversion: 2.20 time: 0.093691 Jun 16 12:33:20.669852 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 379/748] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:33:20 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 1282 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 12:33:20.961671 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9260f360-3b5e-45a0-b677-6626037151cd tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:20.962414 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9260f360-3b5e-45a0-b677-6626037151cd tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9fe7b62b-623e-46c4-9b2d-2c744c2b3512] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:21.028245 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9260f360-3b5e-45a0-b677-6626037151cd tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:21.037055 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9260f360-3b5e-45a0-b677-6626037151cd tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/9fe7b62b-623e-46c4-9b2d-2c744c2b3512" status: 200 len: 1240 microversion: 2.1 time: 0.080135 Jun 16 12:33:21.040224 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 370/749] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:33:20 2022] GET /compute/v2.1/servers/9fe7b62b-623e-46c4-9b2d-2c744c2b3512 => generated 1240 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:33:21.247855 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f21df1e8-a1ef-42cb-9244-4a2a48b0e702 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:21.248471 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f21df1e8-a1ef-42cb-9244-4a2a48b0e702 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] [instance: 198edd63-e22e-42ca-8c37-89b4f87bab60] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:21.255639 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f21df1e8-a1ef-42cb-9244-4a2a48b0e702 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:21.256416 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f21df1e8-a1ef-42cb-9244-4a2a48b0e702 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:21.257327 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f21df1e8-a1ef-42cb-9244-4a2a48b0e702 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:21.257886 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f21df1e8-a1ef-42cb-9244-4a2a48b0e702 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:21.279791 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:33:21.441797 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f21df1e8-a1ef-42cb-9244-4a2a48b0e702 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f18557a45846c1bd9075f8a0717652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf2d3eca81148afa04159506decfdce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:21.450266 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f21df1e8-a1ef-42cb-9244-4a2a48b0e702 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] 10.222.0.45 "GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60" status: 200 len: 1261 microversion: 2.1 time: 0.206764 Jun 16 12:33:21.451240 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 380/750] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:33:21 2022] GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60 => generated 1261 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:33:21.558898 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-c234a03d-e534-401f-8f58-5bb6c6a4a65d req-0bfa0c66-5669-4a5a-935f-208146fa97db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "198edd63-e22e-42ca-8c37-89b4f87bab60", "tag": "9d06019c-16e2-447d-a476-b5bcbaca8ea9"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:33:21.569959 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-c234a03d-e534-401f-8f58-5bb6c6a4a65d req-0bfa0c66-5669-4a5a-935f-208146fa97db service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:21.571928 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-c234a03d-e534-401f-8f58-5bb6c6a4a65d req-0bfa0c66-5669-4a5a-935f-208146fa97db service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:21.584439 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-c234a03d-e534-401f-8f58-5bb6c6a4a65d req-0bfa0c66-5669-4a5a-935f-208146fa97db service nova] Creating event network-changed:9d06019c-16e2-447d-a476-b5bcbaca8ea9 for instance 198edd63-e22e-42ca-8c37-89b4f87bab60 on hv-cinder-84614 Jun 16 12:33:21.595609 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-c234a03d-e534-401f-8f58-5bb6c6a4a65d req-0bfa0c66-5669-4a5a-935f-208146fa97db service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040357 Jun 16 12:33:21.600362 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 371/751] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:33:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:33:21.686577 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4e4cb247-542d-4cbe-b53f-91ac7fb50188 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:21.687194 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4e4cb247-542d-4cbe-b53f-91ac7fb50188 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:21.693328 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4e4cb247-542d-4cbe-b53f-91ac7fb50188 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:21.693785 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4e4cb247-542d-4cbe-b53f-91ac7fb50188 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:21.694648 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4e4cb247-542d-4cbe-b53f-91ac7fb50188 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:21.695121 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4e4cb247-542d-4cbe-b53f-91ac7fb50188 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:21.758165 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4e4cb247-542d-4cbe-b53f-91ac7fb50188 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:21.766544 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4e4cb247-542d-4cbe-b53f-91ac7fb50188 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:21.768043 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4e4cb247-542d-4cbe-b53f-91ac7fb50188 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:21.769130 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4e4cb247-542d-4cbe-b53f-91ac7fb50188 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 200 len: 1286 microversion: 2.20 time: 0.086509 Jun 16 12:33:21.769695 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 381/752] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:33:21 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 1286 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:33:22.059060 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1016f79f-7b06-42c8-9436-aa2c048ea607 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:22.061073 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1016f79f-7b06-42c8-9436-aa2c048ea607 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9fe7b62b-623e-46c4-9b2d-2c744c2b3512] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:22.070102 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1016f79f-7b06-42c8-9436-aa2c048ea607 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:22.070601 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1016f79f-7b06-42c8-9436-aa2c048ea607 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:22.071584 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1016f79f-7b06-42c8-9436-aa2c048ea607 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:22.073545 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1016f79f-7b06-42c8-9436-aa2c048ea607 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:22.172294 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1016f79f-7b06-42c8-9436-aa2c048ea607 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:22.183717 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1016f79f-7b06-42c8-9436-aa2c048ea607 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/9fe7b62b-623e-46c4-9b2d-2c744c2b3512" status: 200 len: 1310 microversion: 2.1 time: 0.131512 Jun 16 12:33:22.184446 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 372/753] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:33:22 2022] GET /compute/v2.1/servers/9fe7b62b-623e-46c4-9b2d-2c744c2b3512 => generated 1310 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:33:22.468384 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-62806f56-b919-44e7-a3d2-9c6bf2319ea5 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:22.469091 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-62806f56-b919-44e7-a3d2-9c6bf2319ea5 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] [instance: 198edd63-e22e-42ca-8c37-89b4f87bab60] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:22.475610 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-62806f56-b919-44e7-a3d2-9c6bf2319ea5 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:22.476062 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-62806f56-b919-44e7-a3d2-9c6bf2319ea5 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:22.476821 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-62806f56-b919-44e7-a3d2-9c6bf2319ea5 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:22.477445 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-62806f56-b919-44e7-a3d2-9c6bf2319ea5 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:22.696896 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-62806f56-b919-44e7-a3d2-9c6bf2319ea5 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f18557a45846c1bd9075f8a0717652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf2d3eca81148afa04159506decfdce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:22.705657 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-62806f56-b919-44e7-a3d2-9c6bf2319ea5 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] 10.222.0.45 "GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60" status: 200 len: 1261 microversion: 2.1 time: 0.241074 Jun 16 12:33:22.706268 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 382/754] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:33:22 2022] GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60 => generated 1261 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:33:22.787153 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-893d38ae-836b-4241-b6d3-6a55c2ba7a28 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:22.787775 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-893d38ae-836b-4241-b6d3-6a55c2ba7a28 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:22.795093 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-893d38ae-836b-4241-b6d3-6a55c2ba7a28 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:22.795537 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-893d38ae-836b-4241-b6d3-6a55c2ba7a28 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:22.796429 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-893d38ae-836b-4241-b6d3-6a55c2ba7a28 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:22.796854 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-893d38ae-836b-4241-b6d3-6a55c2ba7a28 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:22.886401 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-893d38ae-836b-4241-b6d3-6a55c2ba7a28 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:22.894511 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-893d38ae-836b-4241-b6d3-6a55c2ba7a28 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:22.896031 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-893d38ae-836b-4241-b6d3-6a55c2ba7a28 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:22.897346 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-893d38ae-836b-4241-b6d3-6a55c2ba7a28 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 200 len: 1334 microversion: 2.20 time: 0.114078 Jun 16 12:33:22.908543 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 373/755] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:33:22 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 1334 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:33:23.200913 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f3e0c6d7-031e-4172-96b3-b60cbb1b8304 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:23.201529 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f3e0c6d7-031e-4172-96b3-b60cbb1b8304 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9fe7b62b-623e-46c4-9b2d-2c744c2b3512] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:23.207599 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f3e0c6d7-031e-4172-96b3-b60cbb1b8304 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:23.208049 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f3e0c6d7-031e-4172-96b3-b60cbb1b8304 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:23.208809 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f3e0c6d7-031e-4172-96b3-b60cbb1b8304 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:23.209246 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f3e0c6d7-031e-4172-96b3-b60cbb1b8304 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:23.714424 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f3e0c6d7-031e-4172-96b3-b60cbb1b8304 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:23.723929 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-cf6923ee-5a74-4a5d-a058-c01e3b79b7c6 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:23.724538 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-cf6923ee-5a74-4a5d-a058-c01e3b79b7c6 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] [instance: 198edd63-e22e-42ca-8c37-89b4f87bab60] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:23.733625 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f3e0c6d7-031e-4172-96b3-b60cbb1b8304 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/9fe7b62b-623e-46c4-9b2d-2c744c2b3512" status: 200 len: 1366 microversion: 2.1 time: 0.536918 Jun 16 12:33:23.734236 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 383/756] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:33:23 2022] GET /compute/v2.1/servers/9fe7b62b-623e-46c4-9b2d-2c744c2b3512 => generated 1366 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:33:23.737601 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cf6923ee-5a74-4a5d-a058-c01e3b79b7c6 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:23.738088 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cf6923ee-5a74-4a5d-a058-c01e3b79b7c6 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:23.738852 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cf6923ee-5a74-4a5d-a058-c01e3b79b7c6 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:23.739280 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cf6923ee-5a74-4a5d-a058-c01e3b79b7c6 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:23.916764 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0fbc71c3-722f-4af7-93ae-b0ce3865e1eb tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:23.917394 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0fbc71c3-722f-4af7-93ae-b0ce3865e1eb tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:23.923389 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0fbc71c3-722f-4af7-93ae-b0ce3865e1eb tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:23.923839 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0fbc71c3-722f-4af7-93ae-b0ce3865e1eb tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:23.924605 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0fbc71c3-722f-4af7-93ae-b0ce3865e1eb tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:23.925038 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0fbc71c3-722f-4af7-93ae-b0ce3865e1eb tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:24.032211 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0fbc71c3-722f-4af7-93ae-b0ce3865e1eb tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:24.036885 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-cf6923ee-5a74-4a5d-a058-c01e3b79b7c6 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f18557a45846c1bd9075f8a0717652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf2d3eca81148afa04159506decfdce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:24.044835 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0fbc71c3-722f-4af7-93ae-b0ce3865e1eb tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:24.046399 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0fbc71c3-722f-4af7-93ae-b0ce3865e1eb tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:24.046619 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-cf6923ee-5a74-4a5d-a058-c01e3b79b7c6 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] 10.222.0.45 "GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60" status: 200 len: 1261 microversion: 2.1 time: 0.325947 Jun 16 12:33:24.047594 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0fbc71c3-722f-4af7-93ae-b0ce3865e1eb tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 200 len: 1340 microversion: 2.20 time: 0.135364 Jun 16 12:33:24.048814 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 384/757] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:33:23 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 1340 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 12:33:24.056504 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 374/758] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:33:23 2022] GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60 => generated 1261 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:33:24.571053 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-d550a0d3-6ed5-4141-9985-075f31a14340 req-536fea47-1c6d-4b67-b8a2-2e8daacbfad7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fe7b62b-623e-46c4-9b2d-2c744c2b3512", "tag": "b739847a-8a47-4ad0-87ce-05ff1725ccd3"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:33:24.582485 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-d550a0d3-6ed5-4141-9985-075f31a14340 req-536fea47-1c6d-4b67-b8a2-2e8daacbfad7 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:24.583895 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-d550a0d3-6ed5-4141-9985-075f31a14340 req-536fea47-1c6d-4b67-b8a2-2e8daacbfad7 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:24.611392 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-d550a0d3-6ed5-4141-9985-075f31a14340 req-536fea47-1c6d-4b67-b8a2-2e8daacbfad7 service nova] Creating event network-changed:b739847a-8a47-4ad0-87ce-05ff1725ccd3 for instance 9fe7b62b-623e-46c4-9b2d-2c744c2b3512 on hv-cinder-84614 Jun 16 12:33:24.618271 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-d550a0d3-6ed5-4141-9985-075f31a14340 req-536fea47-1c6d-4b67-b8a2-2e8daacbfad7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051604 Jun 16 12:33:24.620495 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 385/759] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:33:24.751704 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ef84023a-b615-4a41-b7d2-291c180c0880 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:24.752233 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ef84023a-b615-4a41-b7d2-291c180c0880 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9fe7b62b-623e-46c4-9b2d-2c744c2b3512] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:24.758639 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ef84023a-b615-4a41-b7d2-291c180c0880 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:24.759086 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ef84023a-b615-4a41-b7d2-291c180c0880 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:24.760589 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ef84023a-b615-4a41-b7d2-291c180c0880 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:24.761047 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ef84023a-b615-4a41-b7d2-291c180c0880 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:25.040175 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ef84023a-b615-4a41-b7d2-291c180c0880 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:25.047708 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ef84023a-b615-4a41-b7d2-291c180c0880 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/9fe7b62b-623e-46c4-9b2d-2c744c2b3512" status: 200 len: 1366 microversion: 2.1 time: 0.299916 Jun 16 12:33:25.048374 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 375/760] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:33:24 2022] GET /compute/v2.1/servers/9fe7b62b-623e-46c4-9b2d-2c744c2b3512 => generated 1366 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:33:25.064930 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-42dd94af-de26-40a6-9454-e8470473c382 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:25.066059 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-42dd94af-de26-40a6-9454-e8470473c382 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] [instance: 198edd63-e22e-42ca-8c37-89b4f87bab60] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:25.066257 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-048d3b2c-7553-45db-a18c-e9fc1e677a99 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:25.067071 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-048d3b2c-7553-45db-a18c-e9fc1e677a99 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:25.072858 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-42dd94af-de26-40a6-9454-e8470473c382 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:25.073522 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-42dd94af-de26-40a6-9454-e8470473c382 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:25.074119 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-048d3b2c-7553-45db-a18c-e9fc1e677a99 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:25.074531 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-42dd94af-de26-40a6-9454-e8470473c382 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:25.074642 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-048d3b2c-7553-45db-a18c-e9fc1e677a99 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:25.074977 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-42dd94af-de26-40a6-9454-e8470473c382 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:25.075326 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-048d3b2c-7553-45db-a18c-e9fc1e677a99 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:25.075760 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-048d3b2c-7553-45db-a18c-e9fc1e677a99 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:25.470413 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-42dd94af-de26-40a6-9454-e8470473c382 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f18557a45846c1bd9075f8a0717652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf2d3eca81148afa04159506decfdce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:25.476891 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-048d3b2c-7553-45db-a18c-e9fc1e677a99 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:25.478827 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-42dd94af-de26-40a6-9454-e8470473c382 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] 10.222.0.45 "GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60" status: 200 len: 1261 microversion: 2.1 time: 0.418307 Jun 16 12:33:25.486968 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-048d3b2c-7553-45db-a18c-e9fc1e677a99 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:25.488937 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-048d3b2c-7553-45db-a18c-e9fc1e677a99 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:25.489077 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 386/761] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:33:25 2022] GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60 => generated 1261 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:33:25.490458 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-048d3b2c-7553-45db-a18c-e9fc1e677a99 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 200 len: 1408 microversion: 2.20 time: 0.427897 Jun 16 12:33:25.491209 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 376/762] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:33:25 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 1408 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:33:26.064902 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-406b540b-9eec-4ed0-bf70-570a406b1f63 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:26.065511 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-406b540b-9eec-4ed0-bf70-570a406b1f63 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9fe7b62b-623e-46c4-9b2d-2c744c2b3512] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:26.073835 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-406b540b-9eec-4ed0-bf70-570a406b1f63 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:26.074313 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-406b540b-9eec-4ed0-bf70-570a406b1f63 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:26.075256 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-406b540b-9eec-4ed0-bf70-570a406b1f63 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:26.075703 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-406b540b-9eec-4ed0-bf70-570a406b1f63 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:26.209504 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-406b540b-9eec-4ed0-bf70-570a406b1f63 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:26.216908 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-406b540b-9eec-4ed0-bf70-570a406b1f63 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/9fe7b62b-623e-46c4-9b2d-2c744c2b3512" status: 200 len: 1366 microversion: 2.1 time: 0.156269 Jun 16 12:33:26.217481 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 387/763] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:33:26 2022] GET /compute/v2.1/servers/9fe7b62b-623e-46c4-9b2d-2c744c2b3512 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:33:26.496325 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-82ae4b5c-52fb-430d-9b2a-82211ed5a9fb tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:26.496946 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-82ae4b5c-52fb-430d-9b2a-82211ed5a9fb tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] [instance: 198edd63-e22e-42ca-8c37-89b4f87bab60] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:26.503196 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-82ae4b5c-52fb-430d-9b2a-82211ed5a9fb tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:26.503639 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-82ae4b5c-52fb-430d-9b2a-82211ed5a9fb tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:26.504407 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-82ae4b5c-52fb-430d-9b2a-82211ed5a9fb tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:26.504846 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-82ae4b5c-52fb-430d-9b2a-82211ed5a9fb tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:26.508515 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6360011a-057f-4dbe-a8b3-cb6afb767890 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:26.509134 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6360011a-057f-4dbe-a8b3-cb6afb767890 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:26.515286 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6360011a-057f-4dbe-a8b3-cb6afb767890 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:26.515760 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6360011a-057f-4dbe-a8b3-cb6afb767890 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:26.516524 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6360011a-057f-4dbe-a8b3-cb6afb767890 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:26.516962 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6360011a-057f-4dbe-a8b3-cb6afb767890 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:26.701485 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-82ae4b5c-52fb-430d-9b2a-82211ed5a9fb tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f18557a45846c1bd9075f8a0717652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf2d3eca81148afa04159506decfdce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:26.708983 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-82ae4b5c-52fb-430d-9b2a-82211ed5a9fb tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] 10.222.0.45 "GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60" status: 200 len: 1261 microversion: 2.1 time: 0.217164 Jun 16 12:33:26.709553 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 377/764] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:33:26 2022] GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60 => generated 1261 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:33:26.711879 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6360011a-057f-4dbe-a8b3-cb6afb767890 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:26.720697 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6360011a-057f-4dbe-a8b3-cb6afb767890 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:26.722225 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6360011a-057f-4dbe-a8b3-cb6afb767890 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:26.723332 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6360011a-057f-4dbe-a8b3-cb6afb767890 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 200 len: 1408 microversion: 2.20 time: 0.218685 Jun 16 12:33:26.723882 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 388/765] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:33:26 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 1408 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 12:33:26.724060 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-edf0d1ca-dac8-428a-93e7-a72093116fc6 req-5662c775-5ff9-4988-87dd-bff7c1a23d00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f50c08e9-d310-424a-972c-1c16733a796e", "tag": "54891bff-8bc6-48af-8125-5099eafe66f7"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:33:26.732969 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-edf0d1ca-dac8-428a-93e7-a72093116fc6 req-5662c775-5ff9-4988-87dd-bff7c1a23d00 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:26.733489 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-edf0d1ca-dac8-428a-93e7-a72093116fc6 req-5662c775-5ff9-4988-87dd-bff7c1a23d00 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:26.745984 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-edf0d1ca-dac8-428a-93e7-a72093116fc6 req-5662c775-5ff9-4988-87dd-bff7c1a23d00 service nova] Creating event network-changed:54891bff-8bc6-48af-8125-5099eafe66f7 for instance f50c08e9-d310-424a-972c-1c16733a796e on hv-cinder-84614 Jun 16 12:33:26.750903 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-edf0d1ca-dac8-428a-93e7-a72093116fc6 req-5662c775-5ff9-4988-87dd-bff7c1a23d00 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040185 Jun 16 12:33:26.751424 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 378/766] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:33:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:33:27.234039 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4caf64bb-5e13-4863-a20b-dcbdf2653a04 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:27.234655 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4caf64bb-5e13-4863-a20b-dcbdf2653a04 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9fe7b62b-623e-46c4-9b2d-2c744c2b3512] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:27.241076 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4caf64bb-5e13-4863-a20b-dcbdf2653a04 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:27.241522 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4caf64bb-5e13-4863-a20b-dcbdf2653a04 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:27.242310 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4caf64bb-5e13-4863-a20b-dcbdf2653a04 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:27.242744 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4caf64bb-5e13-4863-a20b-dcbdf2653a04 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:27.375953 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4caf64bb-5e13-4863-a20b-dcbdf2653a04 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:27.383318 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4caf64bb-5e13-4863-a20b-dcbdf2653a04 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/9fe7b62b-623e-46c4-9b2d-2c744c2b3512" status: 200 len: 1366 microversion: 2.1 time: 0.153125 Jun 16 12:33:27.383882 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 389/767] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:33:27 2022] GET /compute/v2.1/servers/9fe7b62b-623e-46c4-9b2d-2c744c2b3512 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:33:27.726628 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-98831926-7c2d-42fa-ab7b-bf41ea970712 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:27.727321 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-98831926-7c2d-42fa-ab7b-bf41ea970712 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] [instance: 198edd63-e22e-42ca-8c37-89b4f87bab60] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:27.733990 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-98831926-7c2d-42fa-ab7b-bf41ea970712 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:27.734439 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-98831926-7c2d-42fa-ab7b-bf41ea970712 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:27.735194 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-98831926-7c2d-42fa-ab7b-bf41ea970712 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:27.735713 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-98831926-7c2d-42fa-ab7b-bf41ea970712 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:27.738322 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:33:27.741547 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f1073de7-eeb2-4333-8ea5-dbea089b29f3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:27.741547 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f1073de7-eeb2-4333-8ea5-dbea089b29f3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:27.747968 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f1073de7-eeb2-4333-8ea5-dbea089b29f3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:27.748422 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f1073de7-eeb2-4333-8ea5-dbea089b29f3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:27.749188 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f1073de7-eeb2-4333-8ea5-dbea089b29f3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:27.749626 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f1073de7-eeb2-4333-8ea5-dbea089b29f3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:28.093748 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-98831926-7c2d-42fa-ab7b-bf41ea970712 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f18557a45846c1bd9075f8a0717652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf2d3eca81148afa04159506decfdce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:28.108174 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-98831926-7c2d-42fa-ab7b-bf41ea970712 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] 10.222.0.45 "GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60" status: 200 len: 1261 microversion: 2.1 time: 0.385626 Jun 16 12:33:28.109180 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 379/768] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:33:27 2022] GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60 => generated 1261 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:33:28.149484 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f1073de7-eeb2-4333-8ea5-dbea089b29f3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:28.160712 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f1073de7-eeb2-4333-8ea5-dbea089b29f3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:28.162523 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f1073de7-eeb2-4333-8ea5-dbea089b29f3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:28.163769 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f1073de7-eeb2-4333-8ea5-dbea089b29f3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 200 len: 1408 microversion: 2.20 time: 0.427019 Jun 16 12:33:28.167464 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 390/769] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:33:27 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 1408 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 12:33:28.399439 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c5453b60-f3af-43d7-834e-d28898c0f38c tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:28.400846 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c5453b60-f3af-43d7-834e-d28898c0f38c tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9fe7b62b-623e-46c4-9b2d-2c744c2b3512] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:28.407830 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c5453b60-f3af-43d7-834e-d28898c0f38c tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:28.408281 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c5453b60-f3af-43d7-834e-d28898c0f38c tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:28.409047 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c5453b60-f3af-43d7-834e-d28898c0f38c tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:28.409489 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c5453b60-f3af-43d7-834e-d28898c0f38c tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:28.537674 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c5453b60-f3af-43d7-834e-d28898c0f38c tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:28.545564 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c5453b60-f3af-43d7-834e-d28898c0f38c tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/9fe7b62b-623e-46c4-9b2d-2c744c2b3512" status: 200 len: 1366 microversion: 2.1 time: 0.149956 Jun 16 12:33:28.546168 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 380/770] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:33:28 2022] GET /compute/v2.1/servers/9fe7b62b-623e-46c4-9b2d-2c744c2b3512 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:33:29.125958 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-02818abd-3354-483e-be06-6f0672e86a78 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:29.126571 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-02818abd-3354-483e-be06-6f0672e86a78 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] [instance: 198edd63-e22e-42ca-8c37-89b4f87bab60] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:29.128945 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell0:SELECT=4 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:33:29.135130 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-02818abd-3354-483e-be06-6f0672e86a78 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:29.135578 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-02818abd-3354-483e-be06-6f0672e86a78 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:29.136340 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-02818abd-3354-483e-be06-6f0672e86a78 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:29.136774 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-02818abd-3354-483e-be06-6f0672e86a78 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:29.184127 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c06e9098-6ac5-446d-b5e5-8c668d29c562 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:29.185168 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c06e9098-6ac5-446d-b5e5-8c668d29c562 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:29.192285 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c06e9098-6ac5-446d-b5e5-8c668d29c562 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:29.192727 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c06e9098-6ac5-446d-b5e5-8c668d29c562 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:29.193500 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c06e9098-6ac5-446d-b5e5-8c668d29c562 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:29.193974 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c06e9098-6ac5-446d-b5e5-8c668d29c562 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:29.341715 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c06e9098-6ac5-446d-b5e5-8c668d29c562 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:29.349713 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c06e9098-6ac5-446d-b5e5-8c668d29c562 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:29.351235 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c06e9098-6ac5-446d-b5e5-8c668d29c562 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:29.352341 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c06e9098-6ac5-446d-b5e5-8c668d29c562 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 200 len: 1408 microversion: 2.20 time: 0.173544 Jun 16 12:33:29.354562 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 381/771] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:33:29 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 1408 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 12:33:29.444120 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-02818abd-3354-483e-be06-6f0672e86a78 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f18557a45846c1bd9075f8a0717652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf2d3eca81148afa04159506decfdce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:29.452459 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-02818abd-3354-483e-be06-6f0672e86a78 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] 10.222.0.45 "GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60" status: 200 len: 1261 microversion: 2.1 time: 0.330386 Jun 16 12:33:29.453025 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 391/772] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:33:29 2022] GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60 => generated 1261 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:33:29.562051 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9a67ee60-5ca2-4513-976e-a891c21ee6a8 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:29.562655 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9a67ee60-5ca2-4513-976e-a891c21ee6a8 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9fe7b62b-623e-46c4-9b2d-2c744c2b3512] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:29.564452 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=2 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:33:29.569722 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9a67ee60-5ca2-4513-976e-a891c21ee6a8 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:29.570196 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9a67ee60-5ca2-4513-976e-a891c21ee6a8 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:29.570949 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9a67ee60-5ca2-4513-976e-a891c21ee6a8 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:29.571385 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9a67ee60-5ca2-4513-976e-a891c21ee6a8 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:29.698992 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9a67ee60-5ca2-4513-976e-a891c21ee6a8 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:29.706426 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9a67ee60-5ca2-4513-976e-a891c21ee6a8 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/9fe7b62b-623e-46c4-9b2d-2c744c2b3512" status: 200 len: 1366 microversion: 2.1 time: 0.148120 Jun 16 12:33:29.706992 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 382/773] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:33:29 2022] GET /compute/v2.1/servers/9fe7b62b-623e-46c4-9b2d-2c744c2b3512 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:33:30.373122 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ecfa00a6-177d-411d-892b-89fba5dc6ed5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:30.373786 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ecfa00a6-177d-411d-892b-89fba5dc6ed5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:30.382026 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ecfa00a6-177d-411d-892b-89fba5dc6ed5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:30.382505 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ecfa00a6-177d-411d-892b-89fba5dc6ed5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:30.383194 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ecfa00a6-177d-411d-892b-89fba5dc6ed5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:30.383642 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ecfa00a6-177d-411d-892b-89fba5dc6ed5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:30.439641 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-bae6cbfe-d2f0-4afd-b96a-bf774e69f1ca req-8cf2b1ee-6d51-4abf-9c89-38ba27d473c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fe7b62b-623e-46c4-9b2d-2c744c2b3512", "name": "network-vif-plugged", "status": "completed", "tag": "b739847a-8a47-4ad0-87ce-05ff1725ccd3"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:33:30.448301 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-bae6cbfe-d2f0-4afd-b96a-bf774e69f1ca req-8cf2b1ee-6d51-4abf-9c89-38ba27d473c3 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:30.449001 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-bae6cbfe-d2f0-4afd-b96a-bf774e69f1ca req-8cf2b1ee-6d51-4abf-9c89-38ba27d473c3 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:30.460169 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-bae6cbfe-d2f0-4afd-b96a-bf774e69f1ca req-8cf2b1ee-6d51-4abf-9c89-38ba27d473c3 service nova] Creating event network-vif-plugged:b739847a-8a47-4ad0-87ce-05ff1725ccd3 for instance 9fe7b62b-623e-46c4-9b2d-2c744c2b3512 on hv-cinder-84614 Jun 16 12:33:30.465673 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-bae6cbfe-d2f0-4afd-b96a-bf774e69f1ca req-8cf2b1ee-6d51-4abf-9c89-38ba27d473c3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104913 Jun 16 12:33:30.466825 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 392/774] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:33:30.471988 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5b09336b-5f03-4634-8bc5-f417f263ab40 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:30.485259 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5b09336b-5f03-4634-8bc5-f417f263ab40 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] [instance: 198edd63-e22e-42ca-8c37-89b4f87bab60] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:30.492142 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5b09336b-5f03-4634-8bc5-f417f263ab40 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:30.492819 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5b09336b-5f03-4634-8bc5-f417f263ab40 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:30.494979 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5b09336b-5f03-4634-8bc5-f417f263ab40 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:30.495752 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5b09336b-5f03-4634-8bc5-f417f263ab40 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:30.568460 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ecfa00a6-177d-411d-892b-89fba5dc6ed5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:30.576930 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ecfa00a6-177d-411d-892b-89fba5dc6ed5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:30.578454 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ecfa00a6-177d-411d-892b-89fba5dc6ed5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:30.579551 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ecfa00a6-177d-411d-892b-89fba5dc6ed5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 200 len: 1408 microversion: 2.20 time: 0.211351 Jun 16 12:33:30.580108 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 383/775] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:33:30 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 1408 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:33:30.657631 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5b09336b-5f03-4634-8bc5-f417f263ab40 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f18557a45846c1bd9075f8a0717652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf2d3eca81148afa04159506decfdce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:30.663249 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell0:SELECT=22 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:33:30.667064 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5b09336b-5f03-4634-8bc5-f417f263ab40 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] 10.222.0.45 "GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60" status: 200 len: 1261 microversion: 2.1 time: 0.197806 Jun 16 12:33:30.667624 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 393/776] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:33:30 2022] GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60 => generated 1261 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:33:30.726522 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8e9e73f2-d342-414c-962f-146df6ef260b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:30.727217 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8e9e73f2-d342-414c-962f-146df6ef260b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9fe7b62b-623e-46c4-9b2d-2c744c2b3512] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:30.735144 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8e9e73f2-d342-414c-962f-146df6ef260b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:30.735598 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8e9e73f2-d342-414c-962f-146df6ef260b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:30.736376 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8e9e73f2-d342-414c-962f-146df6ef260b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:30.736816 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8e9e73f2-d342-414c-962f-146df6ef260b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:30.863183 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8e9e73f2-d342-414c-962f-146df6ef260b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:30.871054 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8e9e73f2-d342-414c-962f-146df6ef260b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/9fe7b62b-623e-46c4-9b2d-2c744c2b3512" status: 200 len: 1366 microversion: 2.1 time: 0.150244 Jun 16 12:33:30.871611 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 384/777] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:33:30 2022] GET /compute/v2.1/servers/9fe7b62b-623e-46c4-9b2d-2c744c2b3512 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:33:31.597888 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4e5f3311-a106-4780-b8ad-9f2d2cdbc058 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:31.598513 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4e5f3311-a106-4780-b8ad-9f2d2cdbc058 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:31.606062 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4e5f3311-a106-4780-b8ad-9f2d2cdbc058 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:31.606452 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4e5f3311-a106-4780-b8ad-9f2d2cdbc058 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:31.607208 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4e5f3311-a106-4780-b8ad-9f2d2cdbc058 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:31.607633 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4e5f3311-a106-4780-b8ad-9f2d2cdbc058 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:31.735168 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4e5f3311-a106-4780-b8ad-9f2d2cdbc058 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:31.736389 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-168b09d5-2d8b-4ef9-99ca-56d8f2118484 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:31.737173 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-168b09d5-2d8b-4ef9-99ca-56d8f2118484 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] [instance: 198edd63-e22e-42ca-8c37-89b4f87bab60] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:31.739021 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=16 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:33:31.743417 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4e5f3311-a106-4780-b8ad-9f2d2cdbc058 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:31.745678 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4e5f3311-a106-4780-b8ad-9f2d2cdbc058 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:31.745821 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-168b09d5-2d8b-4ef9-99ca-56d8f2118484 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:31.746261 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-168b09d5-2d8b-4ef9-99ca-56d8f2118484 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:31.746810 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4e5f3311-a106-4780-b8ad-9f2d2cdbc058 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 200 len: 1408 microversion: 2.20 time: 0.152827 Jun 16 12:33:31.747059 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-168b09d5-2d8b-4ef9-99ca-56d8f2118484 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:31.747500 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-168b09d5-2d8b-4ef9-99ca-56d8f2118484 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:31.748058 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 394/778] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:33:31 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:33:31.880018 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-168b09d5-2d8b-4ef9-99ca-56d8f2118484 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f18557a45846c1bd9075f8a0717652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf2d3eca81148afa04159506decfdce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:31.887596 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-37748658-200f-4199-bbaa-cea6a3fb57d6 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:31.887785 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-168b09d5-2d8b-4ef9-99ca-56d8f2118484 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] 10.222.0.45 "GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60" status: 200 len: 1261 microversion: 2.1 time: 0.155056 Jun 16 12:33:31.888213 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-37748658-200f-4199-bbaa-cea6a3fb57d6 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9fe7b62b-623e-46c4-9b2d-2c744c2b3512] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:31.888368 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 385/779] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:33:31 2022] GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60 => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:33:31.894314 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-37748658-200f-4199-bbaa-cea6a3fb57d6 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:31.894765 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-37748658-200f-4199-bbaa-cea6a3fb57d6 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:31.895528 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-37748658-200f-4199-bbaa-cea6a3fb57d6 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:31.895961 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-37748658-200f-4199-bbaa-cea6a3fb57d6 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:32.022273 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-37748658-200f-4199-bbaa-cea6a3fb57d6 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:32.030127 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-37748658-200f-4199-bbaa-cea6a3fb57d6 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/9fe7b62b-623e-46c4-9b2d-2c744c2b3512" status: 200 len: 1366 microversion: 2.1 time: 0.146487 Jun 16 12:33:32.030956 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 395/780] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:33:31 2022] GET /compute/v2.1/servers/9fe7b62b-623e-46c4-9b2d-2c744c2b3512 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:33:32.492467 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-dd76858a-f961-4c4c-8ce1-3739bee0fa05 req-855690f9-7b40-43aa-ba00-ffc1e938346b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "198edd63-e22e-42ca-8c37-89b4f87bab60", "name": "network-vif-plugged", "status": "completed", "tag": "9d06019c-16e2-447d-a476-b5bcbaca8ea9"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:33:32.501226 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-dd76858a-f961-4c4c-8ce1-3739bee0fa05 req-855690f9-7b40-43aa-ba00-ffc1e938346b service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:32.501665 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-dd76858a-f961-4c4c-8ce1-3739bee0fa05 req-855690f9-7b40-43aa-ba00-ffc1e938346b service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:32.512244 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-dd76858a-f961-4c4c-8ce1-3739bee0fa05 req-855690f9-7b40-43aa-ba00-ffc1e938346b service nova] Creating event network-vif-plugged:9d06019c-16e2-447d-a476-b5bcbaca8ea9 for instance 198edd63-e22e-42ca-8c37-89b4f87bab60 on hv-cinder-84614 Jun 16 12:33:32.517000 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-dd76858a-f961-4c4c-8ce1-3739bee0fa05 req-855690f9-7b40-43aa-ba00-ffc1e938346b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028229 Jun 16 12:33:32.517566 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 386/781] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:33:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:33:32.765087 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d270249a-a051-4570-9358-85e15aba97fb tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:32.765639 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d270249a-a051-4570-9358-85e15aba97fb tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:32.772099 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d270249a-a051-4570-9358-85e15aba97fb tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:32.772551 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d270249a-a051-4570-9358-85e15aba97fb tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:32.773312 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d270249a-a051-4570-9358-85e15aba97fb tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:32.773751 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d270249a-a051-4570-9358-85e15aba97fb tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:32.906181 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6c31e786-f807-46fa-9e87-aa11c3495a64 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:32.906676 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d270249a-a051-4570-9358-85e15aba97fb tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:32.906885 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6c31e786-f807-46fa-9e87-aa11c3495a64 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] [instance: 198edd63-e22e-42ca-8c37-89b4f87bab60] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:32.913173 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6c31e786-f807-46fa-9e87-aa11c3495a64 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:32.913627 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6c31e786-f807-46fa-9e87-aa11c3495a64 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:32.914378 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d270249a-a051-4570-9358-85e15aba97fb tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:32.914525 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6c31e786-f807-46fa-9e87-aa11c3495a64 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:32.914847 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6c31e786-f807-46fa-9e87-aa11c3495a64 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:32.916676 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d270249a-a051-4570-9358-85e15aba97fb tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:32.917808 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d270249a-a051-4570-9358-85e15aba97fb tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 200 len: 1408 microversion: 2.20 time: 0.156681 Jun 16 12:33:32.918395 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 396/782] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:33:32 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:33:33.047798 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-467f2c85-bade-4ca1-99b5-3b2978b0ce29 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:33.048341 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-467f2c85-bade-4ca1-99b5-3b2978b0ce29 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9fe7b62b-623e-46c4-9b2d-2c744c2b3512] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:33.052898 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6c31e786-f807-46fa-9e87-aa11c3495a64 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f18557a45846c1bd9075f8a0717652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf2d3eca81148afa04159506decfdce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:33.054589 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-467f2c85-bade-4ca1-99b5-3b2978b0ce29 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:33.055037 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-467f2c85-bade-4ca1-99b5-3b2978b0ce29 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:33.055808 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-467f2c85-bade-4ca1-99b5-3b2978b0ce29 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:33.056265 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-467f2c85-bade-4ca1-99b5-3b2978b0ce29 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:33.060660 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6c31e786-f807-46fa-9e87-aa11c3495a64 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] 10.222.0.45 "GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60" status: 200 len: 1261 microversion: 2.1 time: 0.159343 Jun 16 12:33:33.068774 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 387/783] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:33:32 2022] GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60 => generated 1261 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:33:33.271100 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-467f2c85-bade-4ca1-99b5-3b2978b0ce29 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:33.279098 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-467f2c85-bade-4ca1-99b5-3b2978b0ce29 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/9fe7b62b-623e-46c4-9b2d-2c744c2b3512" status: 200 len: 1366 microversion: 2.1 time: 0.235373 Jun 16 12:33:33.279672 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 397/784] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:33:33 2022] GET /compute/v2.1/servers/9fe7b62b-623e-46c4-9b2d-2c744c2b3512 => generated 1366 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:33:33.936052 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2e1d90e9-b0bc-46e0-b173-b3c05691a267 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:33.936672 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2e1d90e9-b0bc-46e0-b173-b3c05691a267 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:33.943282 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2e1d90e9-b0bc-46e0-b173-b3c05691a267 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:33.943674 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2e1d90e9-b0bc-46e0-b173-b3c05691a267 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:33.944440 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2e1d90e9-b0bc-46e0-b173-b3c05691a267 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:33.944881 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2e1d90e9-b0bc-46e0-b173-b3c05691a267 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:34.076746 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2e1d90e9-b0bc-46e0-b173-b3c05691a267 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:34.077039 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6a378c7a-14dc-4731-9e6d-34e927f92e4c tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:34.077658 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6a378c7a-14dc-4731-9e6d-34e927f92e4c tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] [instance: 198edd63-e22e-42ca-8c37-89b4f87bab60] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:34.080006 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:33:34.085330 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6a378c7a-14dc-4731-9e6d-34e927f92e4c tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:34.085520 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2e1d90e9-b0bc-46e0-b173-b3c05691a267 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:34.085787 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6a378c7a-14dc-4731-9e6d-34e927f92e4c tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:34.086586 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6a378c7a-14dc-4731-9e6d-34e927f92e4c tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:34.086883 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2e1d90e9-b0bc-46e0-b173-b3c05691a267 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:34.087015 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6a378c7a-14dc-4731-9e6d-34e927f92e4c tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:34.088002 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2e1d90e9-b0bc-46e0-b173-b3c05691a267 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 200 len: 1408 microversion: 2.20 time: 0.156159 Jun 16 12:33:34.088658 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 388/785] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:33:33 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:33:34.105351 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:33:34.217515 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6a378c7a-14dc-4731-9e6d-34e927f92e4c tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f18557a45846c1bd9075f8a0717652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf2d3eca81148afa04159506decfdce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:34.225804 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6a378c7a-14dc-4731-9e6d-34e927f92e4c tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] 10.222.0.45 "GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60" status: 200 len: 1261 microversion: 2.1 time: 0.152557 Jun 16 12:33:34.226397 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 398/786] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:33:34 2022] GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60 => generated 1261 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:33:34.295983 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9922f14e-caed-4f05-9b5f-85f88379fd73 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:34.296598 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9922f14e-caed-4f05-9b5f-85f88379fd73 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9fe7b62b-623e-46c4-9b2d-2c744c2b3512] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:34.302592 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9922f14e-caed-4f05-9b5f-85f88379fd73 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:34.303043 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9922f14e-caed-4f05-9b5f-85f88379fd73 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:34.303808 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9922f14e-caed-4f05-9b5f-85f88379fd73 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:34.304246 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9922f14e-caed-4f05-9b5f-85f88379fd73 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:34.449966 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9922f14e-caed-4f05-9b5f-85f88379fd73 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:34.457700 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9922f14e-caed-4f05-9b5f-85f88379fd73 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/9fe7b62b-623e-46c4-9b2d-2c744c2b3512" status: 200 len: 1366 microversion: 2.1 time: 0.165523 Jun 16 12:33:34.465506 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 389/787] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:33:34 2022] GET /compute/v2.1/servers/9fe7b62b-623e-46c4-9b2d-2c744c2b3512 => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:33:35.106040 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a3882c5b-71b3-4c8f-aee3-183f04c44743 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:35.106753 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a3882c5b-71b3-4c8f-aee3-183f04c44743 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:35.113367 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a3882c5b-71b3-4c8f-aee3-183f04c44743 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:35.113819 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a3882c5b-71b3-4c8f-aee3-183f04c44743 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:35.114616 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a3882c5b-71b3-4c8f-aee3-183f04c44743 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:35.115080 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a3882c5b-71b3-4c8f-aee3-183f04c44743 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:35.242162 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a3882c5b-71b3-4c8f-aee3-183f04c44743 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:35.242780 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-dbce1022-0a06-4976-a7e6-765f724c1ada tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:35.243400 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-dbce1022-0a06-4976-a7e6-765f724c1ada tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] [instance: 198edd63-e22e-42ca-8c37-89b4f87bab60] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:35.250365 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a3882c5b-71b3-4c8f-aee3-183f04c44743 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:35.250538 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dbce1022-0a06-4976-a7e6-765f724c1ada tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:35.250818 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dbce1022-0a06-4976-a7e6-765f724c1ada tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:35.251593 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dbce1022-0a06-4976-a7e6-765f724c1ada tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:35.251870 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a3882c5b-71b3-4c8f-aee3-183f04c44743 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:35.252033 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dbce1022-0a06-4976-a7e6-765f724c1ada tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:35.252972 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a3882c5b-71b3-4c8f-aee3-183f04c44743 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 200 len: 1408 microversion: 2.20 time: 0.152048 Jun 16 12:33:35.253526 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 399/788] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:33:35 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 1408 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:33:35.386501 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-dbce1022-0a06-4976-a7e6-765f724c1ada tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f18557a45846c1bd9075f8a0717652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf2d3eca81148afa04159506decfdce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:35.394238 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-dbce1022-0a06-4976-a7e6-765f724c1ada tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] 10.222.0.45 "GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60" status: 200 len: 1261 microversion: 2.1 time: 0.155188 Jun 16 12:33:35.394938 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 390/789] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:33:35 2022] GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60 => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:33:35.474667 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-fafb7e03-48b1-443a-b47a-a3c5923ede84 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:35.475198 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-fafb7e03-48b1-443a-b47a-a3c5923ede84 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9fe7b62b-623e-46c4-9b2d-2c744c2b3512] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:35.481477 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fafb7e03-48b1-443a-b47a-a3c5923ede84 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:35.481955 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fafb7e03-48b1-443a-b47a-a3c5923ede84 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:35.482725 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fafb7e03-48b1-443a-b47a-a3c5923ede84 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:35.483167 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fafb7e03-48b1-443a-b47a-a3c5923ede84 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:35.609129 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-fafb7e03-48b1-443a-b47a-a3c5923ede84 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:35.616508 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-fafb7e03-48b1-443a-b47a-a3c5923ede84 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/9fe7b62b-623e-46c4-9b2d-2c744c2b3512" status: 200 len: 1556 microversion: 2.1 time: 0.145789 Jun 16 12:33:35.617063 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 400/790] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:33:35 2022] GET /compute/v2.1/servers/9fe7b62b-623e-46c4-9b2d-2c744c2b3512 => generated 1556 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:33:35.632801 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c01e8e48-02fe-4cfe-b2ae-13659186c4eb tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:35.633304 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c01e8e48-02fe-4cfe-b2ae-13659186c4eb tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9fe7b62b-623e-46c4-9b2d-2c744c2b3512] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:35.639979 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c01e8e48-02fe-4cfe-b2ae-13659186c4eb tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:35.640428 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c01e8e48-02fe-4cfe-b2ae-13659186c4eb tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:35.641191 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c01e8e48-02fe-4cfe-b2ae-13659186c4eb tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:35.641636 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c01e8e48-02fe-4cfe-b2ae-13659186c4eb tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:35.717530 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c01e8e48-02fe-4cfe-b2ae-13659186c4eb tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/9fe7b62b-623e-46c4-9b2d-2c744c2b3512/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088498 Jun 16 12:33:35.718173 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 391/791] 10.222.0.45 () {58 vars in 1274 bytes} [Thu Jun 16 12:33:35 2022] GET /compute/v2.1/servers/9fe7b62b-623e-46c4-9b2d-2c744c2b3512/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:33:36.271805 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-069dda68-ffa6-4f59-ab02-a60d3713c380 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:36.272448 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-069dda68-ffa6-4f59-ab02-a60d3713c380 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:36.279488 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-069dda68-ffa6-4f59-ab02-a60d3713c380 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:36.280022 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-069dda68-ffa6-4f59-ab02-a60d3713c380 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:36.281161 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-069dda68-ffa6-4f59-ab02-a60d3713c380 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:36.281642 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-069dda68-ffa6-4f59-ab02-a60d3713c380 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:36.404609 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-f936536d-06ac-435d-ae69-ccc129bd0cea req-997fe9fb-bf37-4a5f-af78-dcebe9936711 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f50c08e9-d310-424a-972c-1c16733a796e", "name": "network-vif-plugged", "status": "completed", "tag": "54891bff-8bc6-48af-8125-5099eafe66f7"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:33:36.418592 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-f936536d-06ac-435d-ae69-ccc129bd0cea req-997fe9fb-bf37-4a5f-af78-dcebe9936711 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:36.419219 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-f936536d-06ac-435d-ae69-ccc129bd0cea req-997fe9fb-bf37-4a5f-af78-dcebe9936711 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:36.435724 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-f936536d-06ac-435d-ae69-ccc129bd0cea req-997fe9fb-bf37-4a5f-af78-dcebe9936711 service nova] Creating event network-vif-plugged:54891bff-8bc6-48af-8125-5099eafe66f7 for instance f50c08e9-d310-424a-972c-1c16733a796e on hv-cinder-84614 Jun 16 12:33:36.443036 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-f936536d-06ac-435d-ae69-ccc129bd0cea req-997fe9fb-bf37-4a5f-af78-dcebe9936711 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042503 Jun 16 12:33:36.444419 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 392/792] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:33:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 12:33:36.452348 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5bf57ff4-80e4-4a5e-bcca-f46b621372c2 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:36.453987 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5bf57ff4-80e4-4a5e-bcca-f46b621372c2 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] [instance: 198edd63-e22e-42ca-8c37-89b4f87bab60] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:36.461316 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5bf57ff4-80e4-4a5e-bcca-f46b621372c2 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:36.461766 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5bf57ff4-80e4-4a5e-bcca-f46b621372c2 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:36.462641 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5bf57ff4-80e4-4a5e-bcca-f46b621372c2 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:36.463229 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5bf57ff4-80e4-4a5e-bcca-f46b621372c2 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:36.576370 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-069dda68-ffa6-4f59-ab02-a60d3713c380 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:36.584239 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-069dda68-ffa6-4f59-ab02-a60d3713c380 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:36.585751 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-069dda68-ffa6-4f59-ab02-a60d3713c380 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:36.586893 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-069dda68-ffa6-4f59-ab02-a60d3713c380 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 200 len: 1408 microversion: 2.20 time: 0.319327 Jun 16 12:33:36.588009 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 401/793] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:33:36 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 1408 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:33:36.665772 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5bf57ff4-80e4-4a5e-bcca-f46b621372c2 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f18557a45846c1bd9075f8a0717652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf2d3eca81148afa04159506decfdce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:36.674593 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5bf57ff4-80e4-4a5e-bcca-f46b621372c2 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] 10.222.0.45 "GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60" status: 200 len: 1445 microversion: 2.1 time: 0.228814 Jun 16 12:33:36.685800 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 393/794] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:33:36 2022] GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60 => generated 1445 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:33:36.690801 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-79f72e4e-9acf-43ce-a50f-0cd7beefd73f tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:36.691408 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-79f72e4e-9acf-43ce-a50f-0cd7beefd73f tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] [instance: 198edd63-e22e-42ca-8c37-89b4f87bab60] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:36.698023 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-79f72e4e-9acf-43ce-a50f-0cd7beefd73f tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:36.698467 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-79f72e4e-9acf-43ce-a50f-0cd7beefd73f tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:36.699223 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-79f72e4e-9acf-43ce-a50f-0cd7beefd73f tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:36.699650 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-79f72e4e-9acf-43ce-a50f-0cd7beefd73f tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:36.885769 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-3b577fa3-025c-48b5-98cc-4321881fdef5 req-4970a53c-27a2-4dde-84ac-3c5c8ba06ea4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fe7b62b-623e-46c4-9b2d-2c744c2b3512", "tag": "b739847a-8a47-4ad0-87ce-05ff1725ccd3"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:33:36.886553 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-79f72e4e-9acf-43ce-a50f-0cd7beefd73f tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f18557a45846c1bd9075f8a0717652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf2d3eca81148afa04159506decfdce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:36.891133 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:33:36.895297 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-3b577fa3-025c-48b5-98cc-4321881fdef5 req-4970a53c-27a2-4dde-84ac-3c5c8ba06ea4 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:36.895445 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-79f72e4e-9acf-43ce-a50f-0cd7beefd73f tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] 10.222.0.45 "GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60" status: 200 len: 1445 microversion: 2.1 time: 0.208282 Jun 16 12:33:36.896059 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-3b577fa3-025c-48b5-98cc-4321881fdef5 req-4970a53c-27a2-4dde-84ac-3c5c8ba06ea4 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:36.897099 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 402/795] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:33:36 2022] GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60 => generated 1445 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:33:36.924742 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-3b577fa3-025c-48b5-98cc-4321881fdef5 req-4970a53c-27a2-4dde-84ac-3c5c8ba06ea4 service nova] Creating event network-changed:b739847a-8a47-4ad0-87ce-05ff1725ccd3 for instance 9fe7b62b-623e-46c4-9b2d-2c744c2b3512 on hv-cinder-84614 Jun 16 12:33:36.932735 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-3b577fa3-025c-48b5-98cc-4321881fdef5 req-4970a53c-27a2-4dde-84ac-3c5c8ba06ea4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051262 Jun 16 12:33:36.934133 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 394/796] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:33:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 12:33:37.608078 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2bea63e4-9793-4cef-83ab-cbb0d0d03748 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:37.609456 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2bea63e4-9793-4cef-83ab-cbb0d0d03748 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:37.616250 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2bea63e4-9793-4cef-83ab-cbb0d0d03748 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:37.617091 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2bea63e4-9793-4cef-83ab-cbb0d0d03748 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:37.618286 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2bea63e4-9793-4cef-83ab-cbb0d0d03748 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:37.619007 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2bea63e4-9793-4cef-83ab-cbb0d0d03748 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:37.766784 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2bea63e4-9793-4cef-83ab-cbb0d0d03748 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:37.777530 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2bea63e4-9793-4cef-83ab-cbb0d0d03748 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:37.785657 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2bea63e4-9793-4cef-83ab-cbb0d0d03748 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:37.786947 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2bea63e4-9793-4cef-83ab-cbb0d0d03748 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 200 len: 1408 microversion: 2.20 time: 0.184883 Jun 16 12:33:37.787536 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 403/797] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:33:37 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 1408 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:33:38.810296 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0152fb61-8215-4d6b-9627-3ef720cdee2d tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:38.810908 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-6f70f24b-a176-4bdf-abbc-031623fceda7 req-d9ee3544-3d46-4b04-970b-207720030475 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "198edd63-e22e-42ca-8c37-89b4f87bab60", "tag": "9d06019c-16e2-447d-a476-b5bcbaca8ea9"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:33:38.812711 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0152fb61-8215-4d6b-9627-3ef720cdee2d tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:38.823259 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0152fb61-8215-4d6b-9627-3ef720cdee2d tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:38.824026 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0152fb61-8215-4d6b-9627-3ef720cdee2d tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:38.825207 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0152fb61-8215-4d6b-9627-3ef720cdee2d tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:38.825465 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-6f70f24b-a176-4bdf-abbc-031623fceda7 req-d9ee3544-3d46-4b04-970b-207720030475 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:38.826044 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-6f70f24b-a176-4bdf-abbc-031623fceda7 req-d9ee3544-3d46-4b04-970b-207720030475 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:38.826420 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0152fb61-8215-4d6b-9627-3ef720cdee2d tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:38.843680 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-6f70f24b-a176-4bdf-abbc-031623fceda7 req-d9ee3544-3d46-4b04-970b-207720030475 service nova] Creating event network-changed:9d06019c-16e2-447d-a476-b5bcbaca8ea9 for instance 198edd63-e22e-42ca-8c37-89b4f87bab60 on hv-cinder-84614 Jun 16 12:33:38.850190 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-6f70f24b-a176-4bdf-abbc-031623fceda7 req-d9ee3544-3d46-4b04-970b-207720030475 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043765 Jun 16 12:33:38.851614 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 404/798] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 12:33:39.030635 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0152fb61-8215-4d6b-9627-3ef720cdee2d tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:39.039338 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0152fb61-8215-4d6b-9627-3ef720cdee2d tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:39.042591 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0152fb61-8215-4d6b-9627-3ef720cdee2d tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:39.043394 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0152fb61-8215-4d6b-9627-3ef720cdee2d tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 200 len: 1408 microversion: 2.20 time: 0.241266 Jun 16 12:33:39.043909 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 395/799] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:33:38 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 1408 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:33:40.065058 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-324112d8-71ca-4eed-8ec2-162b0191afd3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:40.066450 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-324112d8-71ca-4eed-8ec2-162b0191afd3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:40.074321 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-324112d8-71ca-4eed-8ec2-162b0191afd3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:40.074839 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-324112d8-71ca-4eed-8ec2-162b0191afd3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:40.075623 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-324112d8-71ca-4eed-8ec2-162b0191afd3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:40.076060 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-324112d8-71ca-4eed-8ec2-162b0191afd3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:40.336392 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-324112d8-71ca-4eed-8ec2-162b0191afd3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:40.344953 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-324112d8-71ca-4eed-8ec2-162b0191afd3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:40.346468 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-324112d8-71ca-4eed-8ec2-162b0191afd3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:40.347615 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-324112d8-71ca-4eed-8ec2-162b0191afd3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 200 len: 1598 microversion: 2.20 time: 0.287384 Jun 16 12:33:40.348169 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 405/800] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:33:40 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 1598 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:33:40.365284 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-bcf6e747-0ffa-46ff-8302-cb2cd0cd9a39 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:40.365809 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-bcf6e747-0ffa-46ff-8302-cb2cd0cd9a39 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:40.372789 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bcf6e747-0ffa-46ff-8302-cb2cd0cd9a39 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:40.373235 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bcf6e747-0ffa-46ff-8302-cb2cd0cd9a39 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:40.374024 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bcf6e747-0ffa-46ff-8302-cb2cd0cd9a39 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:40.374457 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bcf6e747-0ffa-46ff-8302-cb2cd0cd9a39 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:40.528265 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-bcf6e747-0ffa-46ff-8302-cb2cd0cd9a39 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.167152 Jun 16 12:33:40.528943 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 396/801] 10.222.0.45 () {60 vars in 1315 bytes} [Thu Jun 16 12:33:40 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e/os-interface => generated 284 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 12:33:41.431934 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-5e676cee-4d44-406e-acb1-7888cd7355a0 req-276fbc93-e55c-4cd3-b051-c57674d95565 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f50c08e9-d310-424a-972c-1c16733a796e", "tag": "54891bff-8bc6-48af-8125-5099eafe66f7"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:33:41.440517 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-5e676cee-4d44-406e-acb1-7888cd7355a0 req-276fbc93-e55c-4cd3-b051-c57674d95565 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:41.441044 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-5e676cee-4d44-406e-acb1-7888cd7355a0 req-276fbc93-e55c-4cd3-b051-c57674d95565 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:41.453950 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-5e676cee-4d44-406e-acb1-7888cd7355a0 req-276fbc93-e55c-4cd3-b051-c57674d95565 service nova] Creating event network-changed:54891bff-8bc6-48af-8125-5099eafe66f7 for instance f50c08e9-d310-424a-972c-1c16733a796e on hv-cinder-84614 Jun 16 12:33:41.458872 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-5e676cee-4d44-406e-acb1-7888cd7355a0 req-276fbc93-e55c-4cd3-b051-c57674d95565 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030930 Jun 16 12:33:41.459546 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 406/802] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:33:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:33:47.865145 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a59005ed-f11e-4047-87c8-7b31cd387314 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1613657748"}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:33:47.865723 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a59005ed-f11e-4047-87c8-7b31cd387314 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] [instance: 17f61c67-8ad3-49b1-9efa-045274e693b2] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:47.872825 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a59005ed-f11e-4047-87c8-7b31cd387314 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:47.873271 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a59005ed-f11e-4047-87c8-7b31cd387314 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:47.874046 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a59005ed-f11e-4047-87c8-7b31cd387314 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:47.874477 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a59005ed-f11e-4047-87c8-7b31cd387314 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:48.002451 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.network.security_group_api [None req-a59005ed-f11e-4047-87c8-7b31cd387314 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Removing security group 4b2e7b6e-4ea2-49bc-a5b3-a4b509724984 from port 49fea4da-1208-4fe6-931a-6a66f0c864cf Jun 16 12:33:48.346769 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a59005ed-f11e-4047-87c8-7b31cd387314 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] 10.222.0.45 "POST /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2/action" status: 202 len: 0 microversion: 2.1 time: 0.582321 Jun 16 12:33:48.353490 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 397/803] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Jun 16 12:33:47 2022] POST /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2/action => generated 0 bytes in 587 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 12:33:48.359896 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-37c1fb4c-194b-4c31-86fb-56ed10997e60 req-bd4995c5-41b2-47f0-92bd-d3a240c4ca98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17f61c67-8ad3-49b1-9efa-045274e693b2", "tag": "49fea4da-1208-4fe6-931a-6a66f0c864cf"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:33:48.376073 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-37c1fb4c-194b-4c31-86fb-56ed10997e60 req-bd4995c5-41b2-47f0-92bd-d3a240c4ca98 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:48.376521 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-37c1fb4c-194b-4c31-86fb-56ed10997e60 req-bd4995c5-41b2-47f0-92bd-d3a240c4ca98 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:48.394081 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-37c1fb4c-194b-4c31-86fb-56ed10997e60 req-bd4995c5-41b2-47f0-92bd-d3a240c4ca98 service nova] Creating event network-changed:49fea4da-1208-4fe6-931a-6a66f0c864cf for instance 17f61c67-8ad3-49b1-9efa-045274e693b2 on hv-cinder-84614 Jun 16 12:33:48.413730 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-37c1fb4c-194b-4c31-86fb-56ed10997e60 req-bd4995c5-41b2-47f0-92bd-d3a240c4ca98 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058884 Jun 16 12:33:48.414462 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 407/804] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:33:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:33:49.722733 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7f896c7f-ee4d-4119-8386-d0acf8203292 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:49.723304 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7f896c7f-ee4d-4119-8386-d0acf8203292 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] [instance: 17f61c67-8ad3-49b1-9efa-045274e693b2] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:49.729311 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7f896c7f-ee4d-4119-8386-d0acf8203292 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:49.730411 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7f896c7f-ee4d-4119-8386-d0acf8203292 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:49.731179 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7f896c7f-ee4d-4119-8386-d0acf8203292 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:49.731618 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7f896c7f-ee4d-4119-8386-d0acf8203292 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:49.811824 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:33:49.817856 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.objects.instance [None req-7f896c7f-ee4d-4119-8386-d0acf8203292 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lazy-loading 'services' on Instance uuid 17f61c67-8ad3-49b1-9efa-045274e693b2 {{(pid=117606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 12:33:49.894963 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7f896c7f-ee4d-4119-8386-d0acf8203292 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] 10.222.0.45 "DELETE /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2/os-volume_attachments/41fa0db8-1b87-42e9-8562-decb00630929" status: 202 len: 0 microversion: 2.1 time: 0.176462 Jun 16 12:33:49.895625 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 398/805] 10.222.0.45 () {58 vars in 1415 bytes} [Thu Jun 16 12:33:49 2022] DELETE /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2/os-volume_attachments/41fa0db8-1b87-42e9-8562-decb00630929 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 12:33:49.905900 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8fe00571-40da-43a3-affc-06f02a99d805 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:49.906919 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8fe00571-40da-43a3-affc-06f02a99d805 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] [instance: 17f61c67-8ad3-49b1-9efa-045274e693b2] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:49.914016 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8fe00571-40da-43a3-affc-06f02a99d805 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:49.914391 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8fe00571-40da-43a3-affc-06f02a99d805 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:49.915772 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8fe00571-40da-43a3-affc-06f02a99d805 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:49.916210 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8fe00571-40da-43a3-affc-06f02a99d805 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:49.945081 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8fe00571-40da-43a3-affc-06f02a99d805 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] 10.222.0.45 "GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044230 Jun 16 12:33:49.945644 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 408/806] 10.222.0.45 () {58 vars in 1301 bytes} [Thu Jun 16 12:33:49 2022] GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 12:33:50.429059 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-464c93fb-b369-4573-8068-a507d41cab42 req-7f2d1bd0-1af8-4a73-8dfc-c5fd7ef435d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17f61c67-8ad3-49b1-9efa-045274e693b2", "tag": "49fea4da-1208-4fe6-931a-6a66f0c864cf"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:33:50.440055 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-464c93fb-b369-4573-8068-a507d41cab42 req-7f2d1bd0-1af8-4a73-8dfc-c5fd7ef435d7 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:50.440578 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-464c93fb-b369-4573-8068-a507d41cab42 req-7f2d1bd0-1af8-4a73-8dfc-c5fd7ef435d7 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:50.452512 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-464c93fb-b369-4573-8068-a507d41cab42 req-7f2d1bd0-1af8-4a73-8dfc-c5fd7ef435d7 service nova] Creating event network-changed:49fea4da-1208-4fe6-931a-6a66f0c864cf for instance 17f61c67-8ad3-49b1-9efa-045274e693b2 on hv-cinder-84614 Jun 16 12:33:50.457622 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-464c93fb-b369-4573-8068-a507d41cab42 req-7f2d1bd0-1af8-4a73-8dfc-c5fd7ef435d7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032690 Jun 16 12:33:50.458273 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 399/807] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:33:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:33:50.957831 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8a8c11d9-4783-4ccc-8820-dca705c05212 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:50.958957 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8a8c11d9-4783-4ccc-8820-dca705c05212 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] [instance: 17f61c67-8ad3-49b1-9efa-045274e693b2] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:50.965679 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8a8c11d9-4783-4ccc-8820-dca705c05212 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:50.966170 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8a8c11d9-4783-4ccc-8820-dca705c05212 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:50.966949 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8a8c11d9-4783-4ccc-8820-dca705c05212 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:50.967396 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8a8c11d9-4783-4ccc-8820-dca705c05212 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:50.998191 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8a8c11d9-4783-4ccc-8820-dca705c05212 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] 10.222.0.45 "GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044410 Jun 16 12:33:50.999093 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 409/808] 10.222.0.45 () {58 vars in 1301 bytes} [Thu Jun 16 12:33:50 2022] GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 16 12:33:51.009232 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4e4911f5-a2b2-4ab6-8d1a-f6a5a5c539c9 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:51.010201 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4e4911f5-a2b2-4ab6-8d1a-f6a5a5c539c9 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] [instance: 17f61c67-8ad3-49b1-9efa-045274e693b2] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:51.018053 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4e4911f5-a2b2-4ab6-8d1a-f6a5a5c539c9 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:51.018601 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4e4911f5-a2b2-4ab6-8d1a-f6a5a5c539c9 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:51.019488 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4e4911f5-a2b2-4ab6-8d1a-f6a5a5c539c9 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:51.020064 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4e4911f5-a2b2-4ab6-8d1a-f6a5a5c539c9 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:51.096640 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-4e4911f5-a2b2-4ab6-8d1a-f6a5a5c539c9 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] HTTP exception thrown: Instance 17f61c67-8ad3-49b1-9efa-045274e693b2 is not attached to volume 41fa0db8-1b87-42e9-8562-decb00630929 Jun 16 12:33:51.110759 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4e4911f5-a2b2-4ab6-8d1a-f6a5a5c539c9 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Request method failure captured: Jun 16 12:33:51.110759 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: request: DELETE /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2/os-volume_attachments/41fa0db8-1b87-42e9-8562-decb00630929 HTTP/1.1 Jun 16 12:33:51.110759 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 16 12:33:51.110759 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 16 12:33:51.110759 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Connection: close Jun 16 12:33:51.110759 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 16 12:33:51.110759 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 16 12:33:51.110759 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Host: 10.222.0.45 Jun 16 12:33:51.110759 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 16 12:33:51.110759 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 16 12:33:51.110759 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABiqyHuuTowz5o0KgHiK2BiNxnlTJdtEc4JIuEwCfGKK5R0b_5fnlCVMejOdlb45iwemgcXK69ZB_2IEAGbFeKifE8pfcedX-RIPmlBbfzZSjIoGd6CAUaMvdU5nJKG_S7tQe73vvNJhfb1gX4wGLCxobQ9rxp2_2Bbzl3D_Doxt0jakFo Jun 16 12:33:51.110759 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 16 12:33:51.110759 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 16 12:33:51.110759 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 16 12:33:51.110759 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 16 12:33:51.110759 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 16 12:33:51.110759 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 16 12:33:51.110759 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Id: 01904f10607d4b4bb91b807bff7ba8ee Jun 16 12:33:51.110759 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-TestMinimumBasicScenario-1668295618 Jun 16 12:33:51.110759 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 16 12:33:51.110759 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 16 12:33:51.112467 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/01904f10607d4b4bb91b807bff7ba8ee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/01904f10607d4b4bb91b807bff7ba8ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_01904f10607d4b4bb91b807bff7ba8ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/01904f10607d4b4bb91b807bff7ba8ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Jun 16 12:33:51.112467 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-TestMinimumBasicScenario-1668295618 Jun 16 12:33:51.112467 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 01904f10607d4b4bb91b807bff7ba8ee Jun 16 12:33:51.112467 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1668295618 Jun 16 12:33:51.112467 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User: tempest-TestMinimumBasicScenario-1668295618-project Jun 16 12:33:51.112467 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 16 12:33:51.112467 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 16 12:33:51.112467 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Id: 2e645784fea14d4785df3eefabf77383 Jun 16 12:33:51.112467 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-TestMinimumBasicScenario-1668295618-project Jun 16 12:33:51.112467 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: method: > Jun 16 12:33:51.112467 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: exception: Instance 17f61c67-8ad3-49b1-9efa-045274e693b2 is not attached to volume 41fa0db8-1b87-42e9-8562-decb00630929 Jun 16 12:33:51.113322 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: action_args: {'server_id': '17f61c67-8ad3-49b1-9efa-045274e693b2', 'id': '41fa0db8-1b87-42e9-8562-decb00630929'} Jun 16 12:33:51.113322 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:33:51.113322 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:33:51.113322 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 16 12:33:51.113322 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 16 12:33:51.113322 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 12:33:51.113322 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 12:33:51.113322 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 16 12:33:51.113322 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 16 12:33:51.113322 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 41fa0db8-1b87-42e9-8562-decb00630929. Jun 16 12:33:51.113322 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:33:51.113322 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:33:51.113322 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:33:51.113322 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:33:51.113322 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:33:51.113322 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:33:51.113322 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:33:51.113322 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:33:51.113322 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:33:51.114999 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:33:51.114999 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 16 12:33:51.114999 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 16 12:33:51.114999 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17f61c67-8ad3-49b1-9efa-045274e693b2 is not attached to volume 41fa0db8-1b87-42e9-8562-decb00630929 Jun 16 12:33:51.114999 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:33:51.114999 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:33:51.114999 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:33:51.114999 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:33:51.114999 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:33:51.114999 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:33:51.114999 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:33:51.114999 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:33:51.114999 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17f61c67-8ad3-49b1-9efa-045274e693b2 is not attached to volume 41fa0db8-1b87-42e9-8562-decb00630929 Jun 16 12:33:51.114999 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:33:51.114999 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4e4911f5-a2b2-4ab6-8d1a-f6a5a5c539c9 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Returning 404 to user: Instance 17f61c67-8ad3-49b1-9efa-045274e693b2 is not attached to volume 41fa0db8-1b87-42e9-8562-decb00630929 {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:33:51.116494 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4e4911f5-a2b2-4ab6-8d1a-f6a5a5c539c9 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] 10.222.0.45 "DELETE /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2/os-volume_attachments/41fa0db8-1b87-42e9-8562-decb00630929" status: 404 len: 154 microversion: 2.1 time: 0.107479 Jun 16 12:33:51.116494 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 400/809] 10.222.0.45 () {58 vars in 1415 bytes} [Thu Jun 16 12:33:51 2022] DELETE /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2/os-volume_attachments/41fa0db8-1b87-42e9-8562-decb00630929 => generated 154 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 12:33:52.247447 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-90152965-18fe-4bf7-9e94-cc0dd50ae62d tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:52.247936 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-90152965-18fe-4bf7-9e94-cc0dd50ae62d tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] [instance: 17f61c67-8ad3-49b1-9efa-045274e693b2] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:52.254380 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-90152965-18fe-4bf7-9e94-cc0dd50ae62d tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:52.254835 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-90152965-18fe-4bf7-9e94-cc0dd50ae62d tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:52.255604 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-90152965-18fe-4bf7-9e94-cc0dd50ae62d tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:52.256044 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-90152965-18fe-4bf7-9e94-cc0dd50ae62d tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:52.280591 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-90152965-18fe-4bf7-9e94-cc0dd50ae62d tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] [instance: 17f61c67-8ad3-49b1-9efa-045274e693b2] Going to try to terminate instance {{(pid=117607) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 12:33:52.353888 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-90152965-18fe-4bf7-9e94-cc0dd50ae62d tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] 10.222.0.45 "DELETE /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2" status: 204 len: 0 microversion: 2.1 time: 0.110093 Jun 16 12:33:52.354731 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 410/810] 10.222.0.45 () {58 vars in 1238 bytes} [Thu Jun 16 12:33:52 2022] DELETE /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 12:33:52.364321 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0db5e7aa-463f-44e5-94ca-b4085f5ce84d tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:52.364990 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0db5e7aa-463f-44e5-94ca-b4085f5ce84d tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] [instance: 17f61c67-8ad3-49b1-9efa-045274e693b2] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:52.372087 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0db5e7aa-463f-44e5-94ca-b4085f5ce84d tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:52.372535 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0db5e7aa-463f-44e5-94ca-b4085f5ce84d tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:52.373290 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0db5e7aa-463f-44e5-94ca-b4085f5ce84d tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:52.373723 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0db5e7aa-463f-44e5-94ca-b4085f5ce84d tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:52.506189 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0db5e7aa-463f-44e5-94ca-b4085f5ce84d tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e645784fea14d4785df3eefabf77383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01904f10607d4b4bb91b807bff7ba8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:52.514468 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0db5e7aa-463f-44e5-94ca-b4085f5ce84d tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] 10.222.0.45 "GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2" status: 200 len: 1554 microversion: 2.1 time: 0.154041 Jun 16 12:33:52.515033 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 401/811] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:33:52 2022] GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2 => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:33:53.532422 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-dee1279a-7309-4c65-83cc-40bda0fdc26b tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:53.533116 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-dee1279a-7309-4c65-83cc-40bda0fdc26b tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] [instance: 17f61c67-8ad3-49b1-9efa-045274e693b2] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:53.539545 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dee1279a-7309-4c65-83cc-40bda0fdc26b tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:53.539989 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dee1279a-7309-4c65-83cc-40bda0fdc26b tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:53.541305 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dee1279a-7309-4c65-83cc-40bda0fdc26b tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:53.541737 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dee1279a-7309-4c65-83cc-40bda0fdc26b tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:53.672988 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-dee1279a-7309-4c65-83cc-40bda0fdc26b tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e645784fea14d4785df3eefabf77383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01904f10607d4b4bb91b807bff7ba8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:53.680440 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-dee1279a-7309-4c65-83cc-40bda0fdc26b tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] 10.222.0.45 "GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2" status: 200 len: 1554 microversion: 2.1 time: 0.152473 Jun 16 12:33:53.681010 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 411/812] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:33:53 2022] GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2 => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:33:54.697396 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-211c8a75-a2ea-48d2-8a7c-eca246f96f27 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:54.698039 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-211c8a75-a2ea-48d2-8a7c-eca246f96f27 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] [instance: 17f61c67-8ad3-49b1-9efa-045274e693b2] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:54.704614 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-211c8a75-a2ea-48d2-8a7c-eca246f96f27 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:54.705092 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-211c8a75-a2ea-48d2-8a7c-eca246f96f27 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:54.705856 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-211c8a75-a2ea-48d2-8a7c-eca246f96f27 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:54.706318 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-211c8a75-a2ea-48d2-8a7c-eca246f96f27 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:54.922825 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-211c8a75-a2ea-48d2-8a7c-eca246f96f27 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e645784fea14d4785df3eefabf77383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01904f10607d4b4bb91b807bff7ba8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:33:54.930283 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-211c8a75-a2ea-48d2-8a7c-eca246f96f27 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] 10.222.0.45 "GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2" status: 200 len: 1554 microversion: 2.1 time: 0.236801 Jun 16 12:33:54.931816 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 402/813] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:33:54 2022] GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2 => generated 1554 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:33:55.245782 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-9b226c08-4524-49b8-b379-ebcb0be07187 req-8ca4efc9-c2a5-49eb-aa5a-001cca275fb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17f61c67-8ad3-49b1-9efa-045274e693b2", "name": "network-vif-deleted", "tag": "49fea4da-1208-4fe6-931a-6a66f0c864cf"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:33:55.254653 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-9b226c08-4524-49b8-b379-ebcb0be07187 req-8ca4efc9-c2a5-49eb-aa5a-001cca275fb5 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:55.255094 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-9b226c08-4524-49b8-b379-ebcb0be07187 req-8ca4efc9-c2a5-49eb-aa5a-001cca275fb5 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:55.266963 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-9b226c08-4524-49b8-b379-ebcb0be07187 req-8ca4efc9-c2a5-49eb-aa5a-001cca275fb5 service nova] Creating event network-vif-deleted:49fea4da-1208-4fe6-931a-6a66f0c864cf for instance 17f61c67-8ad3-49b1-9efa-045274e693b2 on hv-cinder-84614 Jun 16 12:33:55.271879 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-9b226c08-4524-49b8-b379-ebcb0be07187 req-8ca4efc9-c2a5-49eb-aa5a-001cca275fb5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030528 Jun 16 12:33:55.272510 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 412/814] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:33:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:33:55.948255 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2aec35db-3c96-4a29-b3ec-90369813c57a tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:55.948865 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2aec35db-3c96-4a29-b3ec-90369813c57a tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] [instance: 17f61c67-8ad3-49b1-9efa-045274e693b2] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:33:55.955311 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2aec35db-3c96-4a29-b3ec-90369813c57a tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:55.955755 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2aec35db-3c96-4a29-b3ec-90369813c57a tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:55.956506 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2aec35db-3c96-4a29-b3ec-90369813c57a tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:33:55.956934 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2aec35db-3c96-4a29-b3ec-90369813c57a tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:33:55.971163 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-2aec35db-3c96-4a29-b3ec-90369813c57a tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] HTTP exception thrown: Instance 17f61c67-8ad3-49b1-9efa-045274e693b2 could not be found. Jun 16 12:33:55.972655 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2aec35db-3c96-4a29-b3ec-90369813c57a tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Request method failure captured: Jun 16 12:33:55.972655 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: request: GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2 HTTP/1.1 Jun 16 12:33:55.972655 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 16 12:33:55.972655 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 16 12:33:55.972655 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Connection: close Jun 16 12:33:55.972655 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 16 12:33:55.972655 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 16 12:33:55.972655 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Host: 10.222.0.45 Jun 16 12:33:55.972655 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 16 12:33:55.972655 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 16 12:33:55.972655 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABiqyHuuTowz5o0KgHiK2BiNxnlTJdtEc4JIuEwCfGKK5R0b_5fnlCVMejOdlb45iwemgcXK69ZB_2IEAGbFeKifE8pfcedX-RIPmlBbfzZSjIoGd6CAUaMvdU5nJKG_S7tQe73vvNJhfb1gX4wGLCxobQ9rxp2_2Bbzl3D_Doxt0jakFo Jun 16 12:33:55.972655 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 16 12:33:55.972655 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 16 12:33:55.972655 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 16 12:33:55.972655 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 16 12:33:55.972655 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 16 12:33:55.972655 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 16 12:33:55.972655 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Id: 01904f10607d4b4bb91b807bff7ba8ee Jun 16 12:33:55.972655 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-TestMinimumBasicScenario-1668295618 Jun 16 12:33:55.972655 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 16 12:33:55.972655 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 16 12:33:55.974244 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/01904f10607d4b4bb91b807bff7ba8ee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/01904f10607d4b4bb91b807bff7ba8ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_01904f10607d4b4bb91b807bff7ba8ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/01904f10607d4b4bb91b807bff7ba8ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Jun 16 12:33:55.974244 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-TestMinimumBasicScenario-1668295618 Jun 16 12:33:55.974244 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 01904f10607d4b4bb91b807bff7ba8ee Jun 16 12:33:55.974244 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1668295618 Jun 16 12:33:55.974244 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User: tempest-TestMinimumBasicScenario-1668295618-project Jun 16 12:33:55.974244 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 16 12:33:55.974244 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 16 12:33:55.974244 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Id: 2e645784fea14d4785df3eefabf77383 Jun 16 12:33:55.974244 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-TestMinimumBasicScenario-1668295618-project Jun 16 12:33:55.974244 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: method: > Jun 16 12:33:55.974244 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: exception: Instance 17f61c67-8ad3-49b1-9efa-045274e693b2 could not be found. Jun 16 12:33:55.974244 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: action_args: {'id': '17f61c67-8ad3-49b1-9efa-045274e693b2'} Jun 16 12:33:55.975132 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:33:55.975132 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:33:55.975132 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:33:55.975132 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:33:55.975132 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:33:55.975132 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:33:55.975132 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:33:55.975132 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:33:55.975132 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:33:55.975132 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:33:55.975132 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17f61c67-8ad3-49b1-9efa-045274e693b2 could not be found. Jun 16 12:33:55.975132 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:33:55.975132 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:33:55.975132 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:33:55.975132 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:33:55.975132 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:33:55.975132 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:33:55.975132 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:33:55.975132 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:33:55.975132 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:33:55.976592 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:33:55.976592 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 12:33:55.976592 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 12:33:55.976592 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:33:55.976592 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:33:55.976592 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:33:55.976592 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:33:55.976592 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17f61c67-8ad3-49b1-9efa-045274e693b2 could not be found. Jun 16 12:33:55.976592 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:33:55.976592 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:33:55.976592 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:33:55.976592 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:33:55.976592 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:33:55.976592 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:33:55.976592 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:33:55.976592 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:33:55.976592 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17f61c67-8ad3-49b1-9efa-045274e693b2 could not be found. Jun 16 12:33:55.976592 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:33:55.978983 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2aec35db-3c96-4a29-b3ec-90369813c57a tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Returning 404 to user: Instance 17f61c67-8ad3-49b1-9efa-045274e693b2 could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:33:55.978983 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2aec35db-3c96-4a29-b3ec-90369813c57a tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] 10.222.0.45 "GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2" status: 404 len: 111 microversion: 2.1 time: 0.030105 Jun 16 12:33:55.978983 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 403/815] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:33:55 2022] GET /compute/v2.1/servers/17f61c67-8ad3-49b1-9efa-045274e693b2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 12:33:55.984093 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-55dbae13-9a86-4877-95a6-3784c48ca9b4 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] Calling method '.version_select at 0x7f7c71f56670>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:33:56.000608 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-55dbae13-9a86-4877-95a6-3784c48ca9b4 tempest-TestMinimumBasicScenario-1668295618 tempest-TestMinimumBasicScenario-1668295618-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-421292343" status: 202 len: 0 microversion: 2.1 time: 0.020771 Jun 16 12:33:56.001146 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 413/816] 10.222.0.45 () {58 vars in 1268 bytes} [Thu Jun 16 12:33:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-421292343 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 12:34:08.544140 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4d24a691-9a18-4348-aa54-40d9149710cf tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:34:08.544705 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4d24a691-9a18-4348-aa54-40d9149710cf tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c2472931-f1a1-4aec-963a-63a7495b733b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:34:08.547320 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=19 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:34:08.547961 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=26,nova_cell1:INSERT=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:34:08.554080 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4d24a691-9a18-4348-aa54-40d9149710cf tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:34:08.554526 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4d24a691-9a18-4348-aa54-40d9149710cf tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:34:08.555882 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4d24a691-9a18-4348-aa54-40d9149710cf tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:34:08.556321 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4d24a691-9a18-4348-aa54-40d9149710cf tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:34:08.638680 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.objects.instance [None req-4d24a691-9a18-4348-aa54-40d9149710cf tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lazy-loading 'services' on Instance uuid c2472931-f1a1-4aec-963a-63a7495b733b {{(pid=117606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 12:34:08.712007 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4d24a691-9a18-4348-aa54-40d9149710cf tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "DELETE /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b/os-volume_attachments/d9ef1a7a-3570-47da-9ae3-aa36a08c2a0f" status: 202 len: 0 microversion: 2.1 time: 0.170974 Jun 16 12:34:08.712809 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 404/817] 10.222.0.45 () {58 vars in 1415 bytes} [Thu Jun 16 12:34:08 2022] DELETE /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b/os-volume_attachments/d9ef1a7a-3570-47da-9ae3-aa36a08c2a0f => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 12:34:08.718633 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:34:08.719387 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:34:08.723916 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-41ecb781-4451-4847-a93b-8a1790b8102f tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:34:08.724985 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-41ecb781-4451-4847-a93b-8a1790b8102f tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c2472931-f1a1-4aec-963a-63a7495b733b] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:34:08.734538 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-41ecb781-4451-4847-a93b-8a1790b8102f tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:34:08.734996 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-41ecb781-4451-4847-a93b-8a1790b8102f tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:34:08.735779 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-41ecb781-4451-4847-a93b-8a1790b8102f tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:34:08.736220 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-41ecb781-4451-4847-a93b-8a1790b8102f tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:34:08.767200 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-41ecb781-4451-4847-a93b-8a1790b8102f tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050035 Jun 16 12:34:08.767774 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 414/818] 10.222.0.45 () {58 vars in 1301 bytes} [Thu Jun 16 12:34:08 2022] GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:34:09.780987 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5ead58ec-eae7-4fc3-910a-d9adfb50c0ce tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:34:09.782076 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5ead58ec-eae7-4fc3-910a-d9adfb50c0ce tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c2472931-f1a1-4aec-963a-63a7495b733b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:34:09.788319 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5ead58ec-eae7-4fc3-910a-d9adfb50c0ce tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:34:09.788776 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5ead58ec-eae7-4fc3-910a-d9adfb50c0ce tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:34:09.789700 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5ead58ec-eae7-4fc3-910a-d9adfb50c0ce tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:34:09.790172 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5ead58ec-eae7-4fc3-910a-d9adfb50c0ce tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:34:09.817597 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5ead58ec-eae7-4fc3-910a-d9adfb50c0ce tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041697 Jun 16 12:34:09.818194 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 405/819] 10.222.0.45 () {58 vars in 1301 bytes} [Thu Jun 16 12:34:09 2022] GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 12:34:09.888126 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0f8e7e82-edf5-46e9-86dc-18f4be712f7a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:34:09.888635 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0f8e7e82-edf5-46e9-86dc-18f4be712f7a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c2472931-f1a1-4aec-963a-63a7495b733b] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:34:09.895322 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0f8e7e82-edf5-46e9-86dc-18f4be712f7a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:34:09.895772 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0f8e7e82-edf5-46e9-86dc-18f4be712f7a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:34:09.896529 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0f8e7e82-edf5-46e9-86dc-18f4be712f7a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:34:09.897063 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0f8e7e82-edf5-46e9-86dc-18f4be712f7a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:34:09.923498 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0f8e7e82-edf5-46e9-86dc-18f4be712f7a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c2472931-f1a1-4aec-963a-63a7495b733b] Going to try to terminate instance {{(pid=117607) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 12:34:09.996261 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0f8e7e82-edf5-46e9-86dc-18f4be712f7a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "DELETE /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b" status: 204 len: 0 microversion: 2.1 time: 0.111747 Jun 16 12:34:09.996850 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 415/820] 10.222.0.45 () {58 vars in 1238 bytes} [Thu Jun 16 12:34:09 2022] DELETE /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 12:34:10.005237 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-835a7dab-74bc-4da1-a7c7-c5eab1c175a5 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:34:10.005895 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-835a7dab-74bc-4da1-a7c7-c5eab1c175a5 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c2472931-f1a1-4aec-963a-63a7495b733b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:34:10.012493 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-835a7dab-74bc-4da1-a7c7-c5eab1c175a5 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:34:10.012948 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-835a7dab-74bc-4da1-a7c7-c5eab1c175a5 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:34:10.013717 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-835a7dab-74bc-4da1-a7c7-c5eab1c175a5 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:34:10.014193 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-835a7dab-74bc-4da1-a7c7-c5eab1c175a5 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:34:10.143760 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-835a7dab-74bc-4da1-a7c7-c5eab1c175a5 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:34:10.152076 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-835a7dab-74bc-4da1-a7c7-c5eab1c175a5 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b" status: 200 len: 1692 microversion: 2.1 time: 0.150747 Jun 16 12:34:10.152648 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 406/821] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:34:10 2022] GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b => generated 1692 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:34:11.170329 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-9beae0ca-e346-40ff-a7c8-56d270afc120 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:34:11.171025 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-9beae0ca-e346-40ff-a7c8-56d270afc120 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c2472931-f1a1-4aec-963a-63a7495b733b] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:34:11.177347 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9beae0ca-e346-40ff-a7c8-56d270afc120 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:34:11.177795 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9beae0ca-e346-40ff-a7c8-56d270afc120 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:34:11.178576 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9beae0ca-e346-40ff-a7c8-56d270afc120 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:34:11.179007 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9beae0ca-e346-40ff-a7c8-56d270afc120 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:34:11.307585 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-9beae0ca-e346-40ff-a7c8-56d270afc120 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:34:11.315282 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-9beae0ca-e346-40ff-a7c8-56d270afc120 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b" status: 200 len: 1692 microversion: 2.1 time: 0.149285 Jun 16 12:34:11.315854 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 416/822] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:34:11 2022] GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b => generated 1692 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:34:12.332548 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6bbff0b5-0abc-425a-966e-bb03ba80c554 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:34:12.333163 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6bbff0b5-0abc-425a-966e-bb03ba80c554 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c2472931-f1a1-4aec-963a-63a7495b733b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:34:12.339928 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6bbff0b5-0abc-425a-966e-bb03ba80c554 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:34:12.340387 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6bbff0b5-0abc-425a-966e-bb03ba80c554 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:34:12.341151 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6bbff0b5-0abc-425a-966e-bb03ba80c554 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:34:12.341591 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6bbff0b5-0abc-425a-966e-bb03ba80c554 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:34:12.471664 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6bbff0b5-0abc-425a-966e-bb03ba80c554 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:34:12.479252 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6bbff0b5-0abc-425a-966e-bb03ba80c554 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b" status: 200 len: 1692 microversion: 2.1 time: 0.150599 Jun 16 12:34:12.479818 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 407/823] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:34:12 2022] GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b => generated 1692 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:34:13.496702 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2a667946-4a6c-423f-b8fa-b48fddc2abfb tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:34:13.497316 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2a667946-4a6c-423f-b8fa-b48fddc2abfb tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c2472931-f1a1-4aec-963a-63a7495b733b] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:34:13.503902 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2a667946-4a6c-423f-b8fa-b48fddc2abfb tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:34:13.504355 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2a667946-4a6c-423f-b8fa-b48fddc2abfb tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:34:13.505122 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2a667946-4a6c-423f-b8fa-b48fddc2abfb tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:34:13.505567 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2a667946-4a6c-423f-b8fa-b48fddc2abfb tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:34:13.633628 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2a667946-4a6c-423f-b8fa-b48fddc2abfb tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:34:13.642410 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2a667946-4a6c-423f-b8fa-b48fddc2abfb tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b" status: 200 len: 1692 microversion: 2.1 time: 0.150145 Jun 16 12:34:13.642982 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 417/824] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:34:13 2022] GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b => generated 1692 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:34:14.660197 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-58438465-61df-484a-9312-ffc2db2d674e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:34:14.660817 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-58438465-61df-484a-9312-ffc2db2d674e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c2472931-f1a1-4aec-963a-63a7495b733b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:34:14.668939 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-58438465-61df-484a-9312-ffc2db2d674e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:34:14.669396 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-58438465-61df-484a-9312-ffc2db2d674e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:34:14.670206 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-58438465-61df-484a-9312-ffc2db2d674e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:34:14.670650 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-58438465-61df-484a-9312-ffc2db2d674e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:34:14.744799 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-58438465-61df-484a-9312-ffc2db2d674e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:34:14.752336 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-58438465-61df-484a-9312-ffc2db2d674e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b" status: 200 len: 1624 microversion: 2.1 time: 0.096212 Jun 16 12:34:14.753229 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 408/825] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:34:14 2022] GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b => generated 1624 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:34:14.816831 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-83afdd92-8bca-404a-9cb9-376a5650bf7c req-ea8a2351-b64d-47de-a22f-66e8239425f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2472931-f1a1-4aec-963a-63a7495b733b", "name": "network-vif-deleted", "tag": "2aacd7af-3e65-4a78-9162-adc1a6afdbc1"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:34:14.826588 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-83afdd92-8bca-404a-9cb9-376a5650bf7c req-ea8a2351-b64d-47de-a22f-66e8239425f7 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:34:14.826997 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-83afdd92-8bca-404a-9cb9-376a5650bf7c req-ea8a2351-b64d-47de-a22f-66e8239425f7 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:34:14.838857 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-83afdd92-8bca-404a-9cb9-376a5650bf7c req-ea8a2351-b64d-47de-a22f-66e8239425f7 service nova] Creating event network-vif-deleted:2aacd7af-3e65-4a78-9162-adc1a6afdbc1 for instance c2472931-f1a1-4aec-963a-63a7495b733b on hv-cinder-84614 Jun 16 12:34:14.846034 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-83afdd92-8bca-404a-9cb9-376a5650bf7c req-ea8a2351-b64d-47de-a22f-66e8239425f7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032124 Jun 16 12:34:14.846734 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 418/826] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:34:15.770544 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-419bd540-f015-4f8a-87f3-1b616c9f86c2 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:34:15.771183 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-419bd540-f015-4f8a-87f3-1b616c9f86c2 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c2472931-f1a1-4aec-963a-63a7495b733b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:34:15.777661 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-419bd540-f015-4f8a-87f3-1b616c9f86c2 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:34:15.778154 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-419bd540-f015-4f8a-87f3-1b616c9f86c2 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:34:15.778928 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-419bd540-f015-4f8a-87f3-1b616c9f86c2 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:34:15.779363 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-419bd540-f015-4f8a-87f3-1b616c9f86c2 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:34:15.793538 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-419bd540-f015-4f8a-87f3-1b616c9f86c2 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] HTTP exception thrown: Instance c2472931-f1a1-4aec-963a-63a7495b733b could not be found. Jun 16 12:34:15.795208 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-419bd540-f015-4f8a-87f3-1b616c9f86c2 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Request method failure captured: Jun 16 12:34:15.795208 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: request: GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b HTTP/1.1 Jun 16 12:34:15.795208 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 16 12:34:15.795208 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 16 12:34:15.795208 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Connection: close Jun 16 12:34:15.795208 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 16 12:34:15.795208 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 16 12:34:15.795208 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Host: 10.222.0.45 Jun 16 12:34:15.795208 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 16 12:34:15.795208 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 16 12:34:15.795208 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABiqyGES1jPC9zoTp2cmyHjjCfKzUThVvFVDddjyKIwirFIWtW3ZvKtdRT79lGPcaFE642K8AID4DI8GVJJbegi6HvqkNpIy3K9U8GXQ6HrKIxQ5j39hAm1F4SXapv5IvLs7SJL9UbGXGXJJIr0wozEivmIxAYUgMQ3ylzJESix1mP4Yww Jun 16 12:34:15.795208 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 16 12:34:15.795208 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 16 12:34:15.795208 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 16 12:34:15.795208 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 16 12:34:15.795208 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 16 12:34:15.795208 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 16 12:34:15.795208 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Id: 338412f496e246eebc934f348c539335 Jun 16 12:34:15.795208 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-755756367 Jun 16 12:34:15.795208 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 16 12:34:15.795208 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 16 12:34:15.796857 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/338412f496e246eebc934f348c539335"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/338412f496e246eebc934f348c539335"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_338412f496e246eebc934f348c539335"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/338412f496e246eebc934f348c539335"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Jun 16 12:34:15.796857 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-ServerRescueNegativeTestJSON-755756367 Jun 16 12:34:15.796857 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 338412f496e246eebc934f348c539335 Jun 16 12:34:15.796857 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-755756367 Jun 16 12:34:15.796857 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User: tempest-ServerRescueNegativeTestJSON-755756367-project Jun 16 12:34:15.796857 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 16 12:34:15.796857 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 16 12:34:15.796857 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Id: a333ad2fb1c74ef9a666aa591616d7a2 Jun 16 12:34:15.796857 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-ServerRescueNegativeTestJSON-755756367-project Jun 16 12:34:15.796857 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: method: > Jun 16 12:34:15.796857 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: exception: Instance c2472931-f1a1-4aec-963a-63a7495b733b could not be found. Jun 16 12:34:15.796857 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: action_args: {'id': 'c2472931-f1a1-4aec-963a-63a7495b733b'} Jun 16 12:34:15.797743 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:34:15.797743 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:34:15.797743 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:34:15.797743 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:34:15.797743 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:34:15.797743 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:34:15.797743 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:34:15.797743 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:34:15.797743 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:34:15.797743 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:34:15.797743 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2472931-f1a1-4aec-963a-63a7495b733b could not be found. Jun 16 12:34:15.797743 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:34:15.797743 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:34:15.797743 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:34:15.797743 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:34:15.797743 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:34:15.797743 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:34:15.797743 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:34:15.797743 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:34:15.797743 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:34:15.799072 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:34:15.799072 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 12:34:15.799072 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 12:34:15.799072 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:34:15.799072 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:34:15.799072 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:34:15.799072 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:34:15.799072 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2472931-f1a1-4aec-963a-63a7495b733b could not be found. Jun 16 12:34:15.799072 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:34:15.799072 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:34:15.799072 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:34:15.799072 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:34:15.799072 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:34:15.799072 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:34:15.799072 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:34:15.799072 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:34:15.799072 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2472931-f1a1-4aec-963a-63a7495b733b could not be found. Jun 16 12:34:15.799072 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:34:15.800585 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-419bd540-f015-4f8a-87f3-1b616c9f86c2 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Returning 404 to user: Instance c2472931-f1a1-4aec-963a-63a7495b733b could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:34:15.800585 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-419bd540-f015-4f8a-87f3-1b616c9f86c2 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b" status: 404 len: 111 microversion: 2.1 time: 0.029927 Jun 16 12:34:15.800585 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 409/827] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:34:15 2022] GET /compute/v2.1/servers/c2472931-f1a1-4aec-963a-63a7495b733b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 12:34:15.806246 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-80b1bcc4-608b-439a-8ecb-3f0d13ed4567 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '.version_select at 0x7f7c720a4a60>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:34:15.824964 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-80b1bcc4-608b-439a-8ecb-3f0d13ed4567 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1219142562" status: 202 len: 0 microversion: 2.1 time: 0.023385 Jun 16 12:34:15.825658 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 419/828] 10.222.0.45 () {58 vars in 1220 bytes} [Thu Jun 16 12:34:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1219142562 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 12:34:18.901730 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-995e8d6a-cf1f-4739-bbce-0a774426ef8e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:34:18.902273 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-995e8d6a-cf1f-4739-bbce-0a774426ef8e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: 331b2de0-3963-4186-bc19-f2fe2e97d860] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:34:18.908980 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-995e8d6a-cf1f-4739-bbce-0a774426ef8e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:34:18.909426 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-995e8d6a-cf1f-4739-bbce-0a774426ef8e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:34:18.910203 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-995e8d6a-cf1f-4739-bbce-0a774426ef8e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:34:18.910668 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-995e8d6a-cf1f-4739-bbce-0a774426ef8e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:34:18.935649 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-995e8d6a-cf1f-4739-bbce-0a774426ef8e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: 331b2de0-3963-4186-bc19-f2fe2e97d860] Going to try to terminate instance {{(pid=117606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 12:34:19.008485 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-995e8d6a-cf1f-4739-bbce-0a774426ef8e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "DELETE /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860" status: 204 len: 0 microversion: 2.1 time: 0.110268 Jun 16 12:34:19.009193 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 410/829] 10.222.0.45 () {58 vars in 1238 bytes} [Thu Jun 16 12:34:18 2022] DELETE /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 12:34:19.017923 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-53484e79-67b0-4563-bbb4-6e83cd63e90a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:34:19.018665 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-53484e79-67b0-4563-bbb4-6e83cd63e90a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: 331b2de0-3963-4186-bc19-f2fe2e97d860] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:34:19.025962 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-53484e79-67b0-4563-bbb4-6e83cd63e90a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:34:19.026418 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-53484e79-67b0-4563-bbb4-6e83cd63e90a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:34:19.027188 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-53484e79-67b0-4563-bbb4-6e83cd63e90a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:34:19.027625 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-53484e79-67b0-4563-bbb4-6e83cd63e90a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:34:19.159468 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-53484e79-67b0-4563-bbb4-6e83cd63e90a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:34:19.167434 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-53484e79-67b0-4563-bbb4-6e83cd63e90a tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860" status: 200 len: 1507 microversion: 2.1 time: 0.154022 Jun 16 12:34:19.167998 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 420/830] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:34:19 2022] GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:34:20.185625 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3e66d5b0-ec06-431b-8e8e-e84ec1bae5be tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:34:20.186277 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3e66d5b0-ec06-431b-8e8e-e84ec1bae5be tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: 331b2de0-3963-4186-bc19-f2fe2e97d860] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:34:20.192170 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3e66d5b0-ec06-431b-8e8e-e84ec1bae5be tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:34:20.192618 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3e66d5b0-ec06-431b-8e8e-e84ec1bae5be tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:34:20.193374 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3e66d5b0-ec06-431b-8e8e-e84ec1bae5be tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:34:20.193826 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3e66d5b0-ec06-431b-8e8e-e84ec1bae5be tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:34:20.299612 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3e66d5b0-ec06-431b-8e8e-e84ec1bae5be tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:34:20.308469 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3e66d5b0-ec06-431b-8e8e-e84ec1bae5be tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860" status: 200 len: 1465 microversion: 2.1 time: 0.128155 Jun 16 12:34:20.309326 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 411/831] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:34:20 2022] GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860 => generated 1465 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:34:20.360234 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-81dfe400-5629-41e5-95bc-87de5debaeb3 req-2a080b95-cac1-4dee-bcef-2266f22dbda4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "331b2de0-3963-4186-bc19-f2fe2e97d860", "name": "network-vif-deleted", "tag": "cf1f4f7a-bbf2-49a6-8df1-50c33977ca49"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:34:20.374354 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-81dfe400-5629-41e5-95bc-87de5debaeb3 req-2a080b95-cac1-4dee-bcef-2266f22dbda4 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:34:20.374817 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-81dfe400-5629-41e5-95bc-87de5debaeb3 req-2a080b95-cac1-4dee-bcef-2266f22dbda4 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:34:20.387676 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-81dfe400-5629-41e5-95bc-87de5debaeb3 req-2a080b95-cac1-4dee-bcef-2266f22dbda4 service nova] Creating event network-vif-deleted:cf1f4f7a-bbf2-49a6-8df1-50c33977ca49 for instance 331b2de0-3963-4186-bc19-f2fe2e97d860 on hv-cinder-84614 Jun 16 12:34:20.393324 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-81dfe400-5629-41e5-95bc-87de5debaeb3 req-2a080b95-cac1-4dee-bcef-2266f22dbda4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036628 Jun 16 12:34:20.394189 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 421/832] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:34:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:34:21.326145 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-469b3aca-c716-4e59-ba8e-b6f46cca1612 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:34:21.326790 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-469b3aca-c716-4e59-ba8e-b6f46cca1612 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: 331b2de0-3963-4186-bc19-f2fe2e97d860] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:34:21.333134 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-469b3aca-c716-4e59-ba8e-b6f46cca1612 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:34:21.333575 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-469b3aca-c716-4e59-ba8e-b6f46cca1612 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:34:21.334353 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-469b3aca-c716-4e59-ba8e-b6f46cca1612 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:34:21.334787 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-469b3aca-c716-4e59-ba8e-b6f46cca1612 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:34:21.347882 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-469b3aca-c716-4e59-ba8e-b6f46cca1612 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] HTTP exception thrown: Instance 331b2de0-3963-4186-bc19-f2fe2e97d860 could not be found. Jun 16 12:34:21.349513 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-469b3aca-c716-4e59-ba8e-b6f46cca1612 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Request method failure captured: Jun 16 12:34:21.349513 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: request: GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860 HTTP/1.1 Jun 16 12:34:21.349513 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 16 12:34:21.349513 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 16 12:34:21.349513 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Connection: close Jun 16 12:34:21.349513 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 16 12:34:21.349513 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 16 12:34:21.349513 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Host: 10.222.0.45 Jun 16 12:34:21.349513 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 16 12:34:21.349513 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 16 12:34:21.349513 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABiqyGES1jPC9zoTp2cmyHjjCfKzUThVvFVDddjyKIwirFIWtW3ZvKtdRT79lGPcaFE642K8AID4DI8GVJJbegi6HvqkNpIy3K9U8GXQ6HrKIxQ5j39hAm1F4SXapv5IvLs7SJL9UbGXGXJJIr0wozEivmIxAYUgMQ3ylzJESix1mP4Yww Jun 16 12:34:21.349513 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 16 12:34:21.349513 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 16 12:34:21.349513 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 16 12:34:21.349513 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 16 12:34:21.349513 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 16 12:34:21.349513 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 16 12:34:21.349513 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Id: 338412f496e246eebc934f348c539335 Jun 16 12:34:21.349513 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-755756367 Jun 16 12:34:21.349513 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 16 12:34:21.349513 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 16 12:34:21.351089 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/338412f496e246eebc934f348c539335"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/338412f496e246eebc934f348c539335"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_338412f496e246eebc934f348c539335"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/338412f496e246eebc934f348c539335"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Jun 16 12:34:21.351089 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-ServerRescueNegativeTestJSON-755756367 Jun 16 12:34:21.351089 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 338412f496e246eebc934f348c539335 Jun 16 12:34:21.351089 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-755756367 Jun 16 12:34:21.351089 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User: tempest-ServerRescueNegativeTestJSON-755756367-project Jun 16 12:34:21.351089 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 16 12:34:21.351089 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 16 12:34:21.351089 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Id: a333ad2fb1c74ef9a666aa591616d7a2 Jun 16 12:34:21.351089 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-ServerRescueNegativeTestJSON-755756367-project Jun 16 12:34:21.351089 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: method: > Jun 16 12:34:21.351089 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: exception: Instance 331b2de0-3963-4186-bc19-f2fe2e97d860 could not be found. Jun 16 12:34:21.351089 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: action_args: {'id': '331b2de0-3963-4186-bc19-f2fe2e97d860'} Jun 16 12:34:21.351894 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:34:21.351894 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:34:21.351894 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:34:21.351894 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:34:21.351894 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:34:21.351894 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:34:21.351894 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:34:21.351894 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:34:21.351894 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:34:21.351894 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:34:21.351894 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 331b2de0-3963-4186-bc19-f2fe2e97d860 could not be found. Jun 16 12:34:21.351894 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:34:21.351894 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:34:21.351894 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:34:21.351894 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:34:21.351894 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:34:21.351894 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:34:21.351894 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:34:21.351894 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:34:21.351894 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:34:21.353837 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:34:21.353837 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 12:34:21.353837 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 12:34:21.353837 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:34:21.353837 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:34:21.353837 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:34:21.353837 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:34:21.353837 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 331b2de0-3963-4186-bc19-f2fe2e97d860 could not be found. Jun 16 12:34:21.353837 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:34:21.353837 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:34:21.353837 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:34:21.353837 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:34:21.353837 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:34:21.353837 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:34:21.353837 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:34:21.353837 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:34:21.353837 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 331b2de0-3963-4186-bc19-f2fe2e97d860 could not be found. Jun 16 12:34:21.353837 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:34:21.356168 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-469b3aca-c716-4e59-ba8e-b6f46cca1612 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Returning 404 to user: Instance 331b2de0-3963-4186-bc19-f2fe2e97d860 could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:34:21.356168 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-469b3aca-c716-4e59-ba8e-b6f46cca1612 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860" status: 404 len: 111 microversion: 2.1 time: 0.028613 Jun 16 12:34:21.356168 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 412/833] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:34:21 2022] GET /compute/v2.1/servers/331b2de0-3963-4186-bc19-f2fe2e97d860 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 12:34:21.360155 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ec859c4b-c669-49f0-891d-8a5c96c6096f tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:34:21.360752 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ec859c4b-c669-49f0-891d-8a5c96c6096f tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c7405152-1807-4b2a-8701-ef2b2a8cbafb] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:34:21.367626 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ec859c4b-c669-49f0-891d-8a5c96c6096f tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:34:21.368611 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ec859c4b-c669-49f0-891d-8a5c96c6096f tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:34:21.369334 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ec859c4b-c669-49f0-891d-8a5c96c6096f tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:34:21.369770 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ec859c4b-c669-49f0-891d-8a5c96c6096f tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:34:21.394941 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ec859c4b-c669-49f0-891d-8a5c96c6096f tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c7405152-1807-4b2a-8701-ef2b2a8cbafb] Going to try to terminate instance {{(pid=117607) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 12:34:21.471311 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ec859c4b-c669-49f0-891d-8a5c96c6096f tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "DELETE /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb" status: 204 len: 0 microversion: 2.1 time: 0.115151 Jun 16 12:34:21.474358 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 422/834] 10.222.0.45 () {58 vars in 1238 bytes} [Thu Jun 16 12:34:21 2022] DELETE /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 12:34:21.480470 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ebab80f8-a6a8-4824-8717-1ef9e5ce3f0e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:34:21.481080 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ebab80f8-a6a8-4824-8717-1ef9e5ce3f0e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c7405152-1807-4b2a-8701-ef2b2a8cbafb] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:34:21.487159 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ebab80f8-a6a8-4824-8717-1ef9e5ce3f0e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:34:21.487605 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ebab80f8-a6a8-4824-8717-1ef9e5ce3f0e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:34:21.488363 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ebab80f8-a6a8-4824-8717-1ef9e5ce3f0e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:34:21.488796 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ebab80f8-a6a8-4824-8717-1ef9e5ce3f0e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:34:21.616039 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ebab80f8-a6a8-4824-8717-1ef9e5ce3f0e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:34:21.624086 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ebab80f8-a6a8-4824-8717-1ef9e5ce3f0e tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb" status: 200 len: 1521 microversion: 2.1 time: 0.148001 Jun 16 12:34:21.624649 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 413/835] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:34:21 2022] GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:34:22.641976 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-56356afb-de75-41fe-834b-e496dfd18507 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:34:22.642597 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-56356afb-de75-41fe-834b-e496dfd18507 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c7405152-1807-4b2a-8701-ef2b2a8cbafb] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:34:22.649131 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-56356afb-de75-41fe-834b-e496dfd18507 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:34:22.650741 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-56356afb-de75-41fe-834b-e496dfd18507 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:34:22.651536 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-56356afb-de75-41fe-834b-e496dfd18507 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:34:22.652058 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-56356afb-de75-41fe-834b-e496dfd18507 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:34:22.847360 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-fb44a506-087d-43c5-94fa-e4b8a233b070 req-c340dccd-728c-4da9-a39e-c17375099713 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7405152-1807-4b2a-8701-ef2b2a8cbafb", "name": "network-vif-deleted", "tag": "e3f227d9-42cf-4cc8-b18b-eeba97dbf2ba"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:34:22.859368 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-fb44a506-087d-43c5-94fa-e4b8a233b070 req-c340dccd-728c-4da9-a39e-c17375099713 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:34:22.859850 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-fb44a506-087d-43c5-94fa-e4b8a233b070 req-c340dccd-728c-4da9-a39e-c17375099713 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:34:22.872341 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-fb44a506-087d-43c5-94fa-e4b8a233b070 req-c340dccd-728c-4da9-a39e-c17375099713 service nova] Creating event network-vif-deleted:e3f227d9-42cf-4cc8-b18b-eeba97dbf2ba for instance c7405152-1807-4b2a-8701-ef2b2a8cbafb on hv-cinder-84614 Jun 16 12:34:22.874276 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-56356afb-de75-41fe-834b-e496dfd18507 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a333ad2fb1c74ef9a666aa591616d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338412f496e246eebc934f348c539335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:34:22.877785 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-fb44a506-087d-43c5-94fa-e4b8a233b070 req-c340dccd-728c-4da9-a39e-c17375099713 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035142 Jun 16 12:34:22.878763 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 414/836] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:34:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:34:22.886416 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-56356afb-de75-41fe-834b-e496dfd18507 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb" status: 200 len: 1521 microversion: 2.1 time: 0.248685 Jun 16 12:34:22.887540 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 423/837] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:34:22 2022] GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:34:23.905731 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f03418cf-fd77-4ca6-9657-0c657e701ff3 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:34:23.906495 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f03418cf-fd77-4ca6-9657-0c657e701ff3 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] [instance: c7405152-1807-4b2a-8701-ef2b2a8cbafb] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:34:23.912697 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f03418cf-fd77-4ca6-9657-0c657e701ff3 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:34:23.913149 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f03418cf-fd77-4ca6-9657-0c657e701ff3 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:34:23.913929 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f03418cf-fd77-4ca6-9657-0c657e701ff3 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:34:23.914369 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f03418cf-fd77-4ca6-9657-0c657e701ff3 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:34:23.928139 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-f03418cf-fd77-4ca6-9657-0c657e701ff3 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] HTTP exception thrown: Instance c7405152-1807-4b2a-8701-ef2b2a8cbafb could not be found. Jun 16 12:34:23.929760 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f03418cf-fd77-4ca6-9657-0c657e701ff3 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Request method failure captured: Jun 16 12:34:23.929760 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: request: GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb HTTP/1.1 Jun 16 12:34:23.929760 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 16 12:34:23.929760 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 16 12:34:23.929760 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Connection: close Jun 16 12:34:23.929760 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 16 12:34:23.929760 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 16 12:34:23.929760 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Host: 10.222.0.45 Jun 16 12:34:23.929760 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 16 12:34:23.929760 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 16 12:34:23.929760 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABiqyGES1jPC9zoTp2cmyHjjCfKzUThVvFVDddjyKIwirFIWtW3ZvKtdRT79lGPcaFE642K8AID4DI8GVJJbegi6HvqkNpIy3K9U8GXQ6HrKIxQ5j39hAm1F4SXapv5IvLs7SJL9UbGXGXJJIr0wozEivmIxAYUgMQ3ylzJESix1mP4Yww Jun 16 12:34:23.929760 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 16 12:34:23.929760 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 16 12:34:23.929760 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 16 12:34:23.929760 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 16 12:34:23.929760 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 16 12:34:23.929760 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 16 12:34:23.929760 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Id: 338412f496e246eebc934f348c539335 Jun 16 12:34:23.929760 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-755756367 Jun 16 12:34:23.929760 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 16 12:34:23.929760 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 16 12:34:23.932444 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/338412f496e246eebc934f348c539335"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/338412f496e246eebc934f348c539335"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_338412f496e246eebc934f348c539335"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/338412f496e246eebc934f348c539335"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Jun 16 12:34:23.932444 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-ServerRescueNegativeTestJSON-755756367 Jun 16 12:34:23.932444 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 338412f496e246eebc934f348c539335 Jun 16 12:34:23.932444 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-755756367 Jun 16 12:34:23.932444 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User: tempest-ServerRescueNegativeTestJSON-755756367-project Jun 16 12:34:23.932444 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 16 12:34:23.932444 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 16 12:34:23.932444 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Id: a333ad2fb1c74ef9a666aa591616d7a2 Jun 16 12:34:23.932444 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-ServerRescueNegativeTestJSON-755756367-project Jun 16 12:34:23.932444 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: method: > Jun 16 12:34:23.932444 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: exception: Instance c7405152-1807-4b2a-8701-ef2b2a8cbafb could not be found. Jun 16 12:34:23.932444 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: action_args: {'id': 'c7405152-1807-4b2a-8701-ef2b2a8cbafb'} Jun 16 12:34:23.933318 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:34:23.933318 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:34:23.933318 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:34:23.933318 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:34:23.933318 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:34:23.933318 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:34:23.933318 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:34:23.933318 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:34:23.933318 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:34:23.933318 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:34:23.933318 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7405152-1807-4b2a-8701-ef2b2a8cbafb could not be found. Jun 16 12:34:23.933318 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:34:23.933318 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:34:23.933318 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:34:23.933318 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:34:23.933318 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:34:23.933318 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:34:23.933318 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:34:23.933318 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:34:23.933318 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:34:23.934822 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:34:23.934822 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 12:34:23.934822 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 12:34:23.934822 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:34:23.934822 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:34:23.934822 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:34:23.934822 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:34:23.934822 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7405152-1807-4b2a-8701-ef2b2a8cbafb could not be found. Jun 16 12:34:23.934822 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:34:23.934822 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:34:23.934822 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:34:23.934822 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:34:23.934822 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:34:23.934822 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:34:23.934822 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:34:23.934822 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:34:23.934822 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7405152-1807-4b2a-8701-ef2b2a8cbafb could not be found. Jun 16 12:34:23.934822 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:34:23.936326 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f03418cf-fd77-4ca6-9657-0c657e701ff3 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] Returning 404 to user: Instance c7405152-1807-4b2a-8701-ef2b2a8cbafb could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:34:23.936326 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f03418cf-fd77-4ca6-9657-0c657e701ff3 tempest-ServerRescueNegativeTestJSON-755756367 tempest-ServerRescueNegativeTestJSON-755756367-project] 10.222.0.45 "GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb" status: 404 len: 111 microversion: 2.1 time: 0.031182 Jun 16 12:34:23.936326 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 415/838] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:34:23 2022] GET /compute/v2.1/servers/c7405152-1807-4b2a-8701-ef2b2a8cbafb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 12:34:32.124306 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-51999d99-0638-4ada-8463-373ca8bc8f97 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Action: 'create', calling method: .version_select at 0x7f7c71f4a820>, body: {"keypair": {"name": "tempest-keypair-66845392", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNonoDMYfb9Ffvtvw9lFw2GzIr1z61ZyiFRenOMaIn8VSXm2MypriBnNdF67OLgWA3Vy6y7AXAGOAvlDqGfM0XRbF5ykg1NHxOBFuvdCxyJ/IYBz/oLxmsIUdnQYUDBIow=="}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:34:32.141772 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-51999d99-0638-4ada-8463-373ca8bc8f97 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Getting quotas for project eb62ca3babf9402996e0ef47fc0d8e81. Resources: {'key_pairs'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 12:34:32.146062 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-51999d99-0638-4ada-8463-373ca8bc8f97 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Getting quotas for user 1e53fdd4ca2b4fd8b64caea6924fa969 and project eb62ca3babf9402996e0ef47fc0d8e81. Resources: {'key_pairs'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 12:34:32.179713 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-51999d99-0638-4ada-8463-373ca8bc8f97 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.197353 Jun 16 12:34:32.180746 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 424/839] 10.222.0.45 () {60 vars in 1158 bytes} [Thu Jun 16 12:34:31 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:34:33.502150 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6a1a77f3-0778-4dab-a294-980f0145b4c9 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2019271480", "imageRef": "c736a2d2-9d0d-41ec-b9fc-971428b0ff7a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "22375b03-63d5-499f-a2ff-ecb7b82e8fd4"}], "security_groups": [{"name": "tempest-securitygroup--1265467217"}], "key_name": "tempest-keypair-66845392", "user_data": "}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:34:33.609066 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.network.neutron [None req-6a1a77f3-0778-4dab-a294-980f0145b4c9 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] validate_networks() for [('22375b03-63d5-499f-a2ff-ecb7b82e8fd4', None, None, None, None, None)] {{(pid=117606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 12:34:33.919841 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=67,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:34:33.998076 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-6a1a77f3-0778-4dab-a294-980f0145b4c9 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Flavor limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 12:34:33.998525 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-6a1a77f3-0778-4dab-a294-980f0145b4c9 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Image limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 12:34:33.998998 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-6a1a77f3-0778-4dab-a294-980f0145b4c9 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Flavor pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 12:34:33.999405 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-6a1a77f3-0778-4dab-a294-980f0145b4c9 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Image pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 12:34:33.999845 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-6a1a77f3-0778-4dab-a294-980f0145b4c9 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 12:34:34.008932 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6a1a77f3-0778-4dab-a294-980f0145b4c9 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:34:34.009200 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6a1a77f3-0778-4dab-a294-980f0145b4c9 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:34:34.010025 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6a1a77f3-0778-4dab-a294-980f0145b4c9 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:34:34.010460 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6a1a77f3-0778-4dab-a294-980f0145b4c9 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:34:34.028769 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-6a1a77f3-0778-4dab-a294-980f0145b4c9 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Getting quotas for project eb62ca3babf9402996e0ef47fc0d8e81. Resources: {'instances', 'cores', 'ram'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 12:34:34.032935 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-6a1a77f3-0778-4dab-a294-980f0145b4c9 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Getting quotas for user 1e53fdd4ca2b4fd8b64caea6924fa969 and project eb62ca3babf9402996e0ef47fc0d8e81. Resources: {'instances', 'cores', 'ram'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 12:34:34.044617 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6a1a77f3-0778-4dab-a294-980f0145b4c9 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Going to run 1 instances... {{(pid=117606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 12:34:34.046914 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6a1a77f3-0778-4dab-a294-980f0145b4c9 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: 8e91b2d7-1250-4cca-965d-c18107d8c3a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c736a2d2-9d0d-41ec-b9fc-971428b0ff7a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 12:34:34.093304 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6a1a77f3-0778-4dab-a294-980f0145b4c9 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.595374 Jun 16 12:34:34.094175 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 416/840] 10.222.0.45 () {60 vars in 1146 bytes} [Thu Jun 16 12:34:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 12:34:34.104953 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e462f0f6-bc2e-4cc1-8163-2e0326a6ca2f tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:34:34.106281 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e462f0f6-bc2e-4cc1-8163-2e0326a6ca2f tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: 8e91b2d7-1250-4cca-965d-c18107d8c3a1] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:34:34.113558 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:34:34.200688 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e462f0f6-bc2e-4cc1-8163-2e0326a6ca2f tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e53fdd4ca2b4fd8b64caea6924fa969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb62ca3babf9402996e0ef47fc0d8e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:34:34.208212 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e462f0f6-bc2e-4cc1-8163-2e0326a6ca2f tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1" status: 200 len: 1236 microversion: 2.1 time: 0.108050 Jun 16 12:34:34.208690 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 425/841] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:34:34 2022] GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1 => generated 1236 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:34:35.228986 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1918af2f-03a4-425f-b8dd-9f76e8c0e4fb tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:34:35.229620 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1918af2f-03a4-425f-b8dd-9f76e8c0e4fb tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: 8e91b2d7-1250-4cca-965d-c18107d8c3a1] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:34:35.241538 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1918af2f-03a4-425f-b8dd-9f76e8c0e4fb tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:34:35.243565 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1918af2f-03a4-425f-b8dd-9f76e8c0e4fb tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:34:35.244662 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1918af2f-03a4-425f-b8dd-9f76e8c0e4fb tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:34:35.245137 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1918af2f-03a4-425f-b8dd-9f76e8c0e4fb tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:34:35.346053 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1918af2f-03a4-425f-b8dd-9f76e8c0e4fb tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e53fdd4ca2b4fd8b64caea6924fa969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb62ca3babf9402996e0ef47fc0d8e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:34:35.359004 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1918af2f-03a4-425f-b8dd-9f76e8c0e4fb tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1" status: 200 len: 1296 microversion: 2.1 time: 0.135942 Jun 16 12:34:35.360481 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 417/842] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:34:35 2022] GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1 => generated 1296 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:34:36.376900 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-156aeddf-a7fe-49dd-818d-194203620f01 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:34:36.377510 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-156aeddf-a7fe-49dd-818d-194203620f01 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: 8e91b2d7-1250-4cca-965d-c18107d8c3a1] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:34:36.385074 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-156aeddf-a7fe-49dd-818d-194203620f01 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:34:36.385604 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-156aeddf-a7fe-49dd-818d-194203620f01 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:34:36.386481 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-156aeddf-a7fe-49dd-818d-194203620f01 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:34:36.387030 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-156aeddf-a7fe-49dd-818d-194203620f01 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:34:36.610924 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-156aeddf-a7fe-49dd-818d-194203620f01 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e53fdd4ca2b4fd8b64caea6924fa969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb62ca3babf9402996e0ef47fc0d8e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:34:36.619925 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-156aeddf-a7fe-49dd-818d-194203620f01 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1" status: 200 len: 1362 microversion: 2.1 time: 0.247113 Jun 16 12:34:36.620516 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 426/843] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:34:36 2022] GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1 => generated 1362 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:34:36.847988 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-0b6e6902-ae3a-433a-bd4a-ba40eef116c9 req-efd2d111-62d9-4a6b-bab9-c5102018ff13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e91b2d7-1250-4cca-965d-c18107d8c3a1", "tag": "6254bf02-1e64-4fb2-a1b4-c3f29dd8e87a"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:34:36.880391 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-0b6e6902-ae3a-433a-bd4a-ba40eef116c9 req-efd2d111-62d9-4a6b-bab9-c5102018ff13 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:34:36.880881 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-0b6e6902-ae3a-433a-bd4a-ba40eef116c9 req-efd2d111-62d9-4a6b-bab9-c5102018ff13 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:34:36.898823 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-0b6e6902-ae3a-433a-bd4a-ba40eef116c9 req-efd2d111-62d9-4a6b-bab9-c5102018ff13 service nova] Creating event network-changed:6254bf02-1e64-4fb2-a1b4-c3f29dd8e87a for instance 8e91b2d7-1250-4cca-965d-c18107d8c3a1 on hv-cinder-84614 Jun 16 12:34:36.904980 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-0b6e6902-ae3a-433a-bd4a-ba40eef116c9 req-efd2d111-62d9-4a6b-bab9-c5102018ff13 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060658 Jun 16 12:34:36.905588 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 418/844] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:34:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:34:37.637418 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4405182d-efe6-4159-b0b7-601b6153a321 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:34:37.637970 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4405182d-efe6-4159-b0b7-601b6153a321 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: 8e91b2d7-1250-4cca-965d-c18107d8c3a1] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:34:37.643953 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4405182d-efe6-4159-b0b7-601b6153a321 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:34:37.644414 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4405182d-efe6-4159-b0b7-601b6153a321 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:34:37.645205 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4405182d-efe6-4159-b0b7-601b6153a321 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:34:37.645643 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4405182d-efe6-4159-b0b7-601b6153a321 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:34:37.771932 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4405182d-efe6-4159-b0b7-601b6153a321 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e53fdd4ca2b4fd8b64caea6924fa969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb62ca3babf9402996e0ef47fc0d8e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:34:37.780100 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4405182d-efe6-4159-b0b7-601b6153a321 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1" status: 200 len: 1362 microversion: 2.1 time: 0.146865 Jun 16 12:34:37.780659 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 427/845] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:34:37 2022] GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1 => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:34:38.797935 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-956d93a1-e925-42ff-8ed2-be0807a1ed25 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:34:38.798629 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-956d93a1-e925-42ff-8ed2-be0807a1ed25 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: 8e91b2d7-1250-4cca-965d-c18107d8c3a1] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:34:38.801042 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:34:38.807066 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-956d93a1-e925-42ff-8ed2-be0807a1ed25 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:34:38.807513 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-956d93a1-e925-42ff-8ed2-be0807a1ed25 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:34:38.808269 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-956d93a1-e925-42ff-8ed2-be0807a1ed25 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:34:38.808702 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-956d93a1-e925-42ff-8ed2-be0807a1ed25 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:34:38.939534 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-956d93a1-e925-42ff-8ed2-be0807a1ed25 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e53fdd4ca2b4fd8b64caea6924fa969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb62ca3babf9402996e0ef47fc0d8e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:34:38.951477 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-956d93a1-e925-42ff-8ed2-be0807a1ed25 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1" status: 200 len: 1362 microversion: 2.1 time: 0.157748 Jun 16 12:34:38.952019 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 419/846] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:34:38 2022] GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:34:39.968288 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-54348881-63e5-45d9-b010-3f88c6734f07 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:34:39.968906 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-54348881-63e5-45d9-b010-3f88c6734f07 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: 8e91b2d7-1250-4cca-965d-c18107d8c3a1] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:34:39.971219 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:34:39.977562 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-54348881-63e5-45d9-b010-3f88c6734f07 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:34:39.978020 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-54348881-63e5-45d9-b010-3f88c6734f07 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:34:39.978821 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-54348881-63e5-45d9-b010-3f88c6734f07 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:34:39.979261 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-54348881-63e5-45d9-b010-3f88c6734f07 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:34:40.535094 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-54348881-63e5-45d9-b010-3f88c6734f07 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e53fdd4ca2b4fd8b64caea6924fa969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb62ca3babf9402996e0ef47fc0d8e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:34:40.551903 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-54348881-63e5-45d9-b010-3f88c6734f07 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1" status: 200 len: 1362 microversion: 2.1 time: 0.587366 Jun 16 12:34:40.552843 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 428/847] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:34:39 2022] GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1 => generated 1362 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:34:41.571890 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d5983469-91b0-4eba-9fb8-c79e3a10f252 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:34:41.572499 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d5983469-91b0-4eba-9fb8-c79e3a10f252 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: 8e91b2d7-1250-4cca-965d-c18107d8c3a1] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:34:41.579005 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d5983469-91b0-4eba-9fb8-c79e3a10f252 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:34:41.579448 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d5983469-91b0-4eba-9fb8-c79e3a10f252 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:34:41.580204 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d5983469-91b0-4eba-9fb8-c79e3a10f252 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:34:41.580639 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d5983469-91b0-4eba-9fb8-c79e3a10f252 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:34:41.709104 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d5983469-91b0-4eba-9fb8-c79e3a10f252 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e53fdd4ca2b4fd8b64caea6924fa969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb62ca3babf9402996e0ef47fc0d8e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:34:41.716745 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d5983469-91b0-4eba-9fb8-c79e3a10f252 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1" status: 200 len: 1362 microversion: 2.1 time: 0.149732 Jun 16 12:34:41.717290 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 420/848] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:34:41 2022] GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:34:42.649114 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-f917f23c-6364-4a1c-ad0f-2f2032f127c2 req-c36500a8-0865-4608-b74f-64503cdd2945 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e91b2d7-1250-4cca-965d-c18107d8c3a1", "name": "network-vif-plugged", "status": "completed", "tag": "6254bf02-1e64-4fb2-a1b4-c3f29dd8e87a"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:34:42.658221 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-f917f23c-6364-4a1c-ad0f-2f2032f127c2 req-c36500a8-0865-4608-b74f-64503cdd2945 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:34:42.658664 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-f917f23c-6364-4a1c-ad0f-2f2032f127c2 req-c36500a8-0865-4608-b74f-64503cdd2945 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:34:42.670226 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-f917f23c-6364-4a1c-ad0f-2f2032f127c2 req-c36500a8-0865-4608-b74f-64503cdd2945 service nova] Creating event network-vif-plugged:6254bf02-1e64-4fb2-a1b4-c3f29dd8e87a for instance 8e91b2d7-1250-4cca-965d-c18107d8c3a1 on hv-cinder-84614 Jun 16 12:34:42.675304 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-f917f23c-6364-4a1c-ad0f-2f2032f127c2 req-c36500a8-0865-4608-b74f-64503cdd2945 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030310 Jun 16 12:34:42.675935 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 429/849] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:34:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:34:42.733810 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ac70da60-928c-4daa-aec4-b83e33bfb409 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:34:42.734490 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ac70da60-928c-4daa-aec4-b83e33bfb409 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: 8e91b2d7-1250-4cca-965d-c18107d8c3a1] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:34:42.740894 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ac70da60-928c-4daa-aec4-b83e33bfb409 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:34:42.741344 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ac70da60-928c-4daa-aec4-b83e33bfb409 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:34:42.742227 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ac70da60-928c-4daa-aec4-b83e33bfb409 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:34:42.742753 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ac70da60-928c-4daa-aec4-b83e33bfb409 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:34:42.929449 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ac70da60-928c-4daa-aec4-b83e33bfb409 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e53fdd4ca2b4fd8b64caea6924fa969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb62ca3babf9402996e0ef47fc0d8e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:34:42.937416 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ac70da60-928c-4daa-aec4-b83e33bfb409 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1" status: 200 len: 1362 microversion: 2.1 time: 0.207490 Jun 16 12:34:42.937997 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 421/850] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:34:42 2022] GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1 => generated 1362 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:34:43.955331 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5dcf1789-3ce9-4914-8dd8-3e9bae3f117b tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:34:43.956027 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5dcf1789-3ce9-4914-8dd8-3e9bae3f117b tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: 8e91b2d7-1250-4cca-965d-c18107d8c3a1] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:34:43.962307 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5dcf1789-3ce9-4914-8dd8-3e9bae3f117b tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:34:43.962759 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5dcf1789-3ce9-4914-8dd8-3e9bae3f117b tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:34:43.963523 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5dcf1789-3ce9-4914-8dd8-3e9bae3f117b tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:34:43.963959 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5dcf1789-3ce9-4914-8dd8-3e9bae3f117b tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:34:44.094828 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5dcf1789-3ce9-4914-8dd8-3e9bae3f117b tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e53fdd4ca2b4fd8b64caea6924fa969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb62ca3babf9402996e0ef47fc0d8e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:34:44.102734 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5dcf1789-3ce9-4914-8dd8-3e9bae3f117b tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1" status: 200 len: 1362 microversion: 2.1 time: 0.151515 Jun 16 12:34:44.103332 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 430/851] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:34:43 2022] GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:34:45.120893 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4ac9daca-194f-4d97-881c-517d28052594 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:34:45.121537 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4ac9daca-194f-4d97-881c-517d28052594 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: 8e91b2d7-1250-4cca-965d-c18107d8c3a1] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:34:45.123914 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=2 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:34:45.124763 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=6 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:34:45.130745 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4ac9daca-194f-4d97-881c-517d28052594 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:34:45.131203 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4ac9daca-194f-4d97-881c-517d28052594 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:34:45.131970 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4ac9daca-194f-4d97-881c-517d28052594 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:34:45.132410 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4ac9daca-194f-4d97-881c-517d28052594 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:34:45.261005 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4ac9daca-194f-4d97-881c-517d28052594 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e53fdd4ca2b4fd8b64caea6924fa969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb62ca3babf9402996e0ef47fc0d8e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:34:45.268442 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4ac9daca-194f-4d97-881c-517d28052594 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1" status: 200 len: 1547 microversion: 2.1 time: 0.152599 Jun 16 12:34:45.269002 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 422/852] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:34:45 2022] GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1 => generated 1547 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:34:45.285569 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8ffc70e0-a5f8-41af-a5d3-3aaaeae245ea tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:34:45.286120 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8ffc70e0-a5f8-41af-a5d3-3aaaeae245ea tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: 8e91b2d7-1250-4cca-965d-c18107d8c3a1] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:34:45.288088 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell0:SELECT=6 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:34:45.294720 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8ffc70e0-a5f8-41af-a5d3-3aaaeae245ea tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:34:45.295170 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8ffc70e0-a5f8-41af-a5d3-3aaaeae245ea tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:34:45.295935 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8ffc70e0-a5f8-41af-a5d3-3aaaeae245ea tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:34:45.296374 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8ffc70e0-a5f8-41af-a5d3-3aaaeae245ea tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:34:45.373863 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8ffc70e0-a5f8-41af-a5d3-3aaaeae245ea tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092033 Jun 16 12:34:45.374471 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 431/853] 10.222.0.45 () {58 vars in 1274 bytes} [Thu Jun 16 12:34:45 2022] GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:34:46.266838 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-b396f865-c9fe-4668-9c31-6d54cf80680f req-71aa34df-9288-4a88-b037-a5bf08255222 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e91b2d7-1250-4cca-965d-c18107d8c3a1", "tag": "6254bf02-1e64-4fb2-a1b4-c3f29dd8e87a"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:34:46.276487 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-b396f865-c9fe-4668-9c31-6d54cf80680f req-71aa34df-9288-4a88-b037-a5bf08255222 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:34:46.276934 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-b396f865-c9fe-4668-9c31-6d54cf80680f req-71aa34df-9288-4a88-b037-a5bf08255222 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:34:46.288474 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-b396f865-c9fe-4668-9c31-6d54cf80680f req-71aa34df-9288-4a88-b037-a5bf08255222 service nova] Creating event network-changed:6254bf02-1e64-4fb2-a1b4-c3f29dd8e87a for instance 8e91b2d7-1250-4cca-965d-c18107d8c3a1 on hv-cinder-84614 Jun 16 12:34:46.294193 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-b396f865-c9fe-4668-9c31-6d54cf80680f req-71aa34df-9288-4a88-b037-a5bf08255222 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030940 Jun 16 12:34:46.294812 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 423/854] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:34:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:34:59.559362 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=7 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:34:59.560186 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=30 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:34:59.564107 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-79de152a-1d23-4969-a4d3-a12ec1efbe90 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:34:59.564599 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-79de152a-1d23-4969-a4d3-a12ec1efbe90 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:34:59.571318 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-79de152a-1d23-4969-a4d3-a12ec1efbe90 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:34:59.571768 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-79de152a-1d23-4969-a4d3-a12ec1efbe90 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:34:59.572530 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-79de152a-1d23-4969-a4d3-a12ec1efbe90 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:34:59.572965 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-79de152a-1d23-4969-a4d3-a12ec1efbe90 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:34:59.595710 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-79de152a-1d23-4969-a4d3-a12ec1efbe90 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e/ips" status: 200 len: 150 microversion: 2.20 time: 0.037676 Jun 16 12:34:59.596268 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 432/855] 10.222.0.45 () {60 vars in 1288 bytes} [Thu Jun 16 12:34:59 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 12:35:01.577049 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8a99072f-4f8a-4707-93d1-c870cff4f244 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:35:01.577672 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8a99072f-4f8a-4707-93d1-c870cff4f244 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:01.579984 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=9 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:35:01.580627 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=36 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:35:01.586886 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8a99072f-4f8a-4707-93d1-c870cff4f244 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:01.587089 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8a99072f-4f8a-4707-93d1-c870cff4f244 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:01.587846 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8a99072f-4f8a-4707-93d1-c870cff4f244 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:01.588283 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8a99072f-4f8a-4707-93d1-c870cff4f244 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:01.610455 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.objects.instance [None req-8a99072f-4f8a-4707-93d1-c870cff4f244 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lazy-loading 'flavor' on Instance uuid f50c08e9-d310-424a-972c-1c16733a796e {{(pid=117606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 12:35:01.870410 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8a99072f-4f8a-4707-93d1-c870cff4f244 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "POST /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e/action" status: 202 len: 0 microversion: 2.20 time: 0.297362 Jun 16 12:35:01.871152 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 424/856] 10.222.0.45 () {62 vars in 1318 bytes} [Thu Jun 16 12:35:01 2022] POST /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e/action => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 12:35:01.879016 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5986422a-6fc1-4e88-b286-fdb463cb71d4 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:35:01.879650 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5986422a-6fc1-4e88-b286-fdb463cb71d4 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:01.886573 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5986422a-6fc1-4e88-b286-fdb463cb71d4 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:01.887027 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5986422a-6fc1-4e88-b286-fdb463cb71d4 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:01.887798 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5986422a-6fc1-4e88-b286-fdb463cb71d4 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:01.888236 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5986422a-6fc1-4e88-b286-fdb463cb71d4 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:02.022371 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5986422a-6fc1-4e88-b286-fdb463cb71d4 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:02.031299 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5986422a-6fc1-4e88-b286-fdb463cb71d4 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:02.032845 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5986422a-6fc1-4e88-b286-fdb463cb71d4 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:02.034022 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5986422a-6fc1-4e88-b286-fdb463cb71d4 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 200 len: 1723 microversion: 2.20 time: 0.158930 Jun 16 12:35:02.034586 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 433/857] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:35:01 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:35:03.054247 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b4423b2a-4d45-41a0-9686-67fca658d9a7 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:35:03.054898 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b4423b2a-4d45-41a0-9686-67fca658d9a7 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:03.061246 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b4423b2a-4d45-41a0-9686-67fca658d9a7 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:03.061690 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b4423b2a-4d45-41a0-9686-67fca658d9a7 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:03.062468 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b4423b2a-4d45-41a0-9686-67fca658d9a7 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:03.062907 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b4423b2a-4d45-41a0-9686-67fca658d9a7 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:03.194220 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b4423b2a-4d45-41a0-9686-67fca658d9a7 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:03.202824 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b4423b2a-4d45-41a0-9686-67fca658d9a7 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:03.204330 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b4423b2a-4d45-41a0-9686-67fca658d9a7 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:03.205543 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b4423b2a-4d45-41a0-9686-67fca658d9a7 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 200 len: 1723 microversion: 2.20 time: 0.156086 Jun 16 12:35:03.206128 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 425/858] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:35:03 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:35:03.610803 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4da54d6d-3f6d-42b3-ae44-0e84fa7fff62 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:35:03.611349 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4da54d6d-3f6d-42b3-ae44-0e84fa7fff62 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9fe7b62b-623e-46c4-9b2d-2c744c2b3512] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:03.618317 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4da54d6d-3f6d-42b3-ae44-0e84fa7fff62 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:03.618780 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4da54d6d-3f6d-42b3-ae44-0e84fa7fff62 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:03.619538 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4da54d6d-3f6d-42b3-ae44-0e84fa7fff62 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:03.619970 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4da54d6d-3f6d-42b3-ae44-0e84fa7fff62 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:03.641949 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4da54d6d-3f6d-42b3-ae44-0e84fa7fff62 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/9fe7b62b-623e-46c4-9b2d-2c744c2b3512/ips" status: 200 len: 149 microversion: 2.1 time: 0.035049 Jun 16 12:35:03.642493 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 434/859] 10.222.0.45 () {58 vars in 1247 bytes} [Thu Jun 16 12:35:03 2022] GET /compute/v2.1/servers/9fe7b62b-623e-46c4-9b2d-2c744c2b3512/ips => generated 149 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:35:04.223441 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a41a3474-3b6c-4d52-b7b9-39ef8a28a41e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:35:04.224080 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a41a3474-3b6c-4d52-b7b9-39ef8a28a41e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:04.232264 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a41a3474-3b6c-4d52-b7b9-39ef8a28a41e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:04.232714 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a41a3474-3b6c-4d52-b7b9-39ef8a28a41e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:04.233460 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a41a3474-3b6c-4d52-b7b9-39ef8a28a41e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:04.233916 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a41a3474-3b6c-4d52-b7b9-39ef8a28a41e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:04.366761 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a41a3474-3b6c-4d52-b7b9-39ef8a28a41e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:04.377711 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a41a3474-3b6c-4d52-b7b9-39ef8a28a41e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:04.380349 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a41a3474-3b6c-4d52-b7b9-39ef8a28a41e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:04.381498 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a41a3474-3b6c-4d52-b7b9-39ef8a28a41e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 200 len: 1723 microversion: 2.20 time: 0.161884 Jun 16 12:35:04.382085 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 426/860] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:35:04 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:35:04.954935 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d5f26603-8d43-4d82-a072-4e1b865fcaea tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4092038a-7073-4756-ab85-6d0752356c83"}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:35:04.956068 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d5f26603-8d43-4d82-a072-4e1b865fcaea tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9fe7b62b-623e-46c4-9b2d-2c744c2b3512] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:04.962739 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d5f26603-8d43-4d82-a072-4e1b865fcaea tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:04.963190 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d5f26603-8d43-4d82-a072-4e1b865fcaea tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:04.963954 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d5f26603-8d43-4d82-a072-4e1b865fcaea tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:04.964401 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d5f26603-8d43-4d82-a072-4e1b865fcaea tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:05.208860 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d5f26603-8d43-4d82-a072-4e1b865fcaea tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "POST /compute/v2.1/servers/9fe7b62b-623e-46c4-9b2d-2c744c2b3512/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.257634 Jun 16 12:35:05.209465 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 435/861] 10.222.0.45 () {60 vars in 1322 bytes} [Thu Jun 16 12:35:04 2022] POST /compute/v2.1/servers/9fe7b62b-623e-46c4-9b2d-2c744c2b3512/os-volume_attachments => generated 194 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:35:05.400063 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7f97f5ae-9951-4c97-908f-14696f7bdcad tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:35:05.400690 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7f97f5ae-9951-4c97-908f-14696f7bdcad tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:05.407342 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7f97f5ae-9951-4c97-908f-14696f7bdcad tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:05.407828 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7f97f5ae-9951-4c97-908f-14696f7bdcad tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:05.408593 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7f97f5ae-9951-4c97-908f-14696f7bdcad tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:05.409033 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7f97f5ae-9951-4c97-908f-14696f7bdcad tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:05.539931 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7f97f5ae-9951-4c97-908f-14696f7bdcad tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:05.547818 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7f97f5ae-9951-4c97-908f-14696f7bdcad tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:05.549329 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7f97f5ae-9951-4c97-908f-14696f7bdcad tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:05.550549 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7f97f5ae-9951-4c97-908f-14696f7bdcad tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 200 len: 1723 microversion: 2.20 time: 0.154386 Jun 16 12:35:05.551102 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 427/862] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:35:05 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:35:06.568892 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c64d6f90-d00d-4a9d-beb3-69a7012059e6 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:35:06.569591 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c64d6f90-d00d-4a9d-beb3-69a7012059e6 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:06.576640 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c64d6f90-d00d-4a9d-beb3-69a7012059e6 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:06.577094 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c64d6f90-d00d-4a9d-beb3-69a7012059e6 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:06.577856 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c64d6f90-d00d-4a9d-beb3-69a7012059e6 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:06.578319 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c64d6f90-d00d-4a9d-beb3-69a7012059e6 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:06.708217 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c64d6f90-d00d-4a9d-beb3-69a7012059e6 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:06.716236 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c64d6f90-d00d-4a9d-beb3-69a7012059e6 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:06.717738 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c64d6f90-d00d-4a9d-beb3-69a7012059e6 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:06.718924 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c64d6f90-d00d-4a9d-beb3-69a7012059e6 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 200 len: 1723 microversion: 2.20 time: 0.154876 Jun 16 12:35:06.719470 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 436/863] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:35:06 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:35:07.737729 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-30dc60dd-c9b4-4601-9e64-acb861064c47 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:35:07.738368 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-30dc60dd-c9b4-4601-9e64-acb861064c47 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:07.744933 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-30dc60dd-c9b4-4601-9e64-acb861064c47 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:07.745377 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-30dc60dd-c9b4-4601-9e64-acb861064c47 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:07.746226 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-30dc60dd-c9b4-4601-9e64-acb861064c47 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:07.746657 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-30dc60dd-c9b4-4601-9e64-acb861064c47 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:07.872467 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-30dc60dd-c9b4-4601-9e64-acb861064c47 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:07.880269 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-30dc60dd-c9b4-4601-9e64-acb861064c47 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:07.881743 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-30dc60dd-c9b4-4601-9e64-acb861064c47 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:07.882934 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-30dc60dd-c9b4-4601-9e64-acb861064c47 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 200 len: 1723 microversion: 2.20 time: 0.149088 Jun 16 12:35:07.883489 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 428/864] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:35:07 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:35:08.901153 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-04390885-7e4e-4caa-a062-4a9fad757c6e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:35:08.901725 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-04390885-7e4e-4caa-a062-4a9fad757c6e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:08.908533 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-04390885-7e4e-4caa-a062-4a9fad757c6e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:08.908976 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-04390885-7e4e-4caa-a062-4a9fad757c6e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:08.909746 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-04390885-7e4e-4caa-a062-4a9fad757c6e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:08.910207 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-04390885-7e4e-4caa-a062-4a9fad757c6e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:09.039979 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-04390885-7e4e-4caa-a062-4a9fad757c6e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:09.048408 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-04390885-7e4e-4caa-a062-4a9fad757c6e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:09.049933 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-04390885-7e4e-4caa-a062-4a9fad757c6e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:09.051080 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-04390885-7e4e-4caa-a062-4a9fad757c6e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 200 len: 1723 microversion: 2.20 time: 0.154017 Jun 16 12:35:09.051642 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 437/865] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:35:08 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:35:10.069814 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9bfae07e-b7ff-4257-a69c-f391e24d81e4 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:35:10.070460 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9bfae07e-b7ff-4257-a69c-f391e24d81e4 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:10.077216 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9bfae07e-b7ff-4257-a69c-f391e24d81e4 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:10.077667 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9bfae07e-b7ff-4257-a69c-f391e24d81e4 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:10.078455 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9bfae07e-b7ff-4257-a69c-f391e24d81e4 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:10.078897 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9bfae07e-b7ff-4257-a69c-f391e24d81e4 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:10.206105 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9bfae07e-b7ff-4257-a69c-f391e24d81e4 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:10.213965 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9bfae07e-b7ff-4257-a69c-f391e24d81e4 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:10.215487 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9bfae07e-b7ff-4257-a69c-f391e24d81e4 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:10.216629 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9bfae07e-b7ff-4257-a69c-f391e24d81e4 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 200 len: 1723 microversion: 2.20 time: 0.150633 Jun 16 12:35:10.217175 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 429/866] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:35:10 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:35:11.235694 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8ef42982-7b45-4fce-b0ab-00d4cd439bdf tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:35:11.236295 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8ef42982-7b45-4fce-b0ab-00d4cd439bdf tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:11.243510 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8ef42982-7b45-4fce-b0ab-00d4cd439bdf tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:11.244002 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8ef42982-7b45-4fce-b0ab-00d4cd439bdf tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:11.244759 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8ef42982-7b45-4fce-b0ab-00d4cd439bdf tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:11.245191 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8ef42982-7b45-4fce-b0ab-00d4cd439bdf tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:11.377125 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8ef42982-7b45-4fce-b0ab-00d4cd439bdf tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:11.385443 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8ef42982-7b45-4fce-b0ab-00d4cd439bdf tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:11.386999 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8ef42982-7b45-4fce-b0ab-00d4cd439bdf tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:11.388138 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8ef42982-7b45-4fce-b0ab-00d4cd439bdf tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 200 len: 1723 microversion: 2.20 time: 0.156872 Jun 16 12:35:11.388688 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 438/867] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:35:11 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:35:12.405921 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5db9bdc6-e0fd-49d3-b4f0-722295c615e2 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:35:12.406465 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5db9bdc6-e0fd-49d3-b4f0-722295c615e2 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:12.413002 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5db9bdc6-e0fd-49d3-b4f0-722295c615e2 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:12.413446 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5db9bdc6-e0fd-49d3-b4f0-722295c615e2 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:12.414335 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5db9bdc6-e0fd-49d3-b4f0-722295c615e2 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:12.414773 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5db9bdc6-e0fd-49d3-b4f0-722295c615e2 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:12.540744 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5db9bdc6-e0fd-49d3-b4f0-722295c615e2 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:12.549579 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5db9bdc6-e0fd-49d3-b4f0-722295c615e2 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:12.551104 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5db9bdc6-e0fd-49d3-b4f0-722295c615e2 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:12.552244 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5db9bdc6-e0fd-49d3-b4f0-722295c615e2 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 200 len: 1723 microversion: 2.20 time: 0.150518 Jun 16 12:35:12.552793 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 430/868] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:35:12 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:35:12.697513 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-591b449c-6265-438f-a2c1-3d134aba4bb8 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4092038a-7073-4756-ab85-6d0752356c83"}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:35:12.698616 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-591b449c-6265-438f-a2c1-3d134aba4bb8 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9fe7b62b-623e-46c4-9b2d-2c744c2b3512] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:12.704970 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-591b449c-6265-438f-a2c1-3d134aba4bb8 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:12.705410 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-591b449c-6265-438f-a2c1-3d134aba4bb8 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:12.706189 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-591b449c-6265-438f-a2c1-3d134aba4bb8 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:12.706619 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-591b449c-6265-438f-a2c1-3d134aba4bb8 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:12.784107 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-591b449c-6265-438f-a2c1-3d134aba4bb8 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] HTTP exception thrown: Invalid volume: volume 4092038a-7073-4756-ab85-6d0752356c83 is already attached to instances: 9fe7b62b-623e-46c4-9b2d-2c744c2b3512 Jun 16 12:35:12.785833 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-591b449c-6265-438f-a2c1-3d134aba4bb8 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Request method failure captured: Jun 16 12:35:12.785833 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: request: POST /compute/v2.1/servers/9fe7b62b-623e-46c4-9b2d-2c744c2b3512/os-volume_attachments HTTP/1.1 Jun 16 12:35:12.785833 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Accept: application/json Jun 16 12:35:12.785833 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jun 16 12:35:12.785833 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Connection: close Jun 16 12:35:12.785833 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Content-Length: 74 Jun 16 12:35:12.785833 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jun 16 12:35:12.785833 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Host: 10.222.0.45 Jun 16 12:35:12.785833 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jun 16 12:35:12.785833 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jun 16 12:35:12.785833 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABiqyGF1I7NNsn9N-NNLw8e7JwWQfFAz21t9AN_OlEcHKfvG-zVtCE3h0xqQLPiYlGgCbqHJIMx6mphLTjEkYrptZmSsukd0-SUbPj3ipfsUXouJgw4LZCCngD_KxZq-5FKd9EOmAaCBK7p8lhdHrTX3rZ5m9BxXUJmHDIk-Sxu6p9pH_c Jun 16 12:35:12.785833 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jun 16 12:35:12.785833 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jun 16 12:35:12.785833 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jun 16 12:35:12.785833 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jun 16 12:35:12.785833 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jun 16 12:35:12.785833 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jun 16 12:35:12.785833 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Id: 3fce886a9a894240a0b3bd3af94d2465 Jun 16 12:35:12.785833 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-AttachVolumeNegativeTest-1612233326 Jun 16 12:35:12.785833 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Role: member,reader Jun 16 12:35:12.785833 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Roles: member,reader Jun 16 12:35:12.787419 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3fce886a9a894240a0b3bd3af94d2465"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3fce886a9a894240a0b3bd3af94d2465"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3fce886a9a894240a0b3bd3af94d2465"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3fce886a9a894240a0b3bd3af94d2465"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Jun 16 12:35:12.787419 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-AttachVolumeNegativeTest-1612233326 Jun 16 12:35:12.787419 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant-Id: 3fce886a9a894240a0b3bd3af94d2465 Jun 16 12:35:12.787419 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1612233326 Jun 16 12:35:12.787419 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User: tempest-AttachVolumeNegativeTest-1612233326-project Jun 16 12:35:12.787419 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jun 16 12:35:12.787419 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jun 16 12:35:12.787419 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Id: ed6b630c60d640afb1325215ea27acef Jun 16 12:35:12.787419 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-AttachVolumeNegativeTest-1612233326-project Jun 16 12:35:12.787419 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Jun 16 12:35:12.787419 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: {"volumeAttachment": {"volumeId": "4092038a-7073-4756-ab85-6d0752356c83"}} Jun 16 12:35:12.787419 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: method: > Jun 16 12:35:12.788569 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: exception: Invalid volume: volume 4092038a-7073-4756-ab85-6d0752356c83 is already attached to instances: 9fe7b62b-623e-46c4-9b2d-2c744c2b3512 Jun 16 12:35:12.788569 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: action_args: {'server_id': '9fe7b62b-623e-46c4-9b2d-2c744c2b3512', 'body': {'volumeAttachment': {'volumeId': '4092038a-7073-4756-ab85-6d0752356c83'}}} Jun 16 12:35:12.788569 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:35:12.788569 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:35:12.788569 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 16 12:35:12.788569 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 16 12:35:12.788569 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 12:35:12.788569 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 12:35:12.788569 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 16 12:35:12.788569 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 16 12:35:12.788569 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 16 12:35:12.788569 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 16 12:35:12.788569 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 16 12:35:12.788569 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 16 12:35:12.788569 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 4092038a-7073-4756-ab85-6d0752356c83 is already attached to instances: 9fe7b62b-623e-46c4-9b2d-2c744c2b3512 Jun 16 12:35:12.788569 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:35:12.788569 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:35:12.788569 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:35:12.788569 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:35:12.790063 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:35:12.790063 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:35:12.790063 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:35:12.790063 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:35:12.790063 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:35:12.790063 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:35:12.790063 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 12:35:12.790063 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 12:35:12.790063 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 12:35:12.790063 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 12:35:12.790063 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 12:35:12.790063 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 12:35:12.790063 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 16 12:35:12.790063 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 16 12:35:12.790063 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 4092038a-7073-4756-ab85-6d0752356c83 is already attached to instances: 9fe7b62b-623e-46c4-9b2d-2c744c2b3512 Jun 16 12:35:12.790063 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:35:12.790063 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:35:12.790063 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:35:12.790063 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:35:12.790063 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:35:12.792301 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:35:12.792301 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:35:12.792301 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:35:12.792301 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 4092038a-7073-4756-ab85-6d0752356c83 is already attached to instances: 9fe7b62b-623e-46c4-9b2d-2c744c2b3512 Jun 16 12:35:12.792301 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:35:12.792301 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-591b449c-6265-438f-a2c1-3d134aba4bb8 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Returning 400 to user: Invalid volume: volume 4092038a-7073-4756-ab85-6d0752356c83 is already attached to instances: 9fe7b62b-623e-46c4-9b2d-2c744c2b3512 {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:35:12.792301 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-591b449c-6265-438f-a2c1-3d134aba4bb8 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "POST /compute/v2.1/servers/9fe7b62b-623e-46c4-9b2d-2c744c2b3512/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.093794 Jun 16 12:35:12.792301 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 439/869] 10.222.0.45 () {60 vars in 1322 bytes} [Thu Jun 16 12:35:12 2022] POST /compute/v2.1/servers/9fe7b62b-623e-46c4-9b2d-2c744c2b3512/os-volume_attachments => generated 174 bytes in 95 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 12:35:12.846769 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b06b0b56-f622-4552-8a83-7f458b31500c tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:35:12.847262 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b06b0b56-f622-4552-8a83-7f458b31500c tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9fe7b62b-623e-46c4-9b2d-2c744c2b3512] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:12.853112 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b06b0b56-f622-4552-8a83-7f458b31500c tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:12.854404 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b06b0b56-f622-4552-8a83-7f458b31500c tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:12.855257 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b06b0b56-f622-4552-8a83-7f458b31500c tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:12.855699 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b06b0b56-f622-4552-8a83-7f458b31500c tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:12.933543 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.objects.instance [None req-b06b0b56-f622-4552-8a83-7f458b31500c tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lazy-loading 'services' on Instance uuid 9fe7b62b-623e-46c4-9b2d-2c744c2b3512 {{(pid=117606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 12:35:13.004000 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b06b0b56-f622-4552-8a83-7f458b31500c tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "DELETE /compute/v2.1/servers/9fe7b62b-623e-46c4-9b2d-2c744c2b3512/os-volume_attachments/4092038a-7073-4756-ab85-6d0752356c83" status: 202 len: 0 microversion: 2.1 time: 0.160867 Jun 16 12:35:13.004580 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 431/870] 10.222.0.45 () {58 vars in 1415 bytes} [Thu Jun 16 12:35:12 2022] DELETE /compute/v2.1/servers/9fe7b62b-623e-46c4-9b2d-2c744c2b3512/os-volume_attachments/4092038a-7073-4756-ab85-6d0752356c83 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 12:35:13.012987 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4bc07fb6-50c7-4a53-bb0b-46ebb17e9632 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:35:13.014204 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4bc07fb6-50c7-4a53-bb0b-46ebb17e9632 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9fe7b62b-623e-46c4-9b2d-2c744c2b3512] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:13.021010 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4bc07fb6-50c7-4a53-bb0b-46ebb17e9632 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:13.021465 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4bc07fb6-50c7-4a53-bb0b-46ebb17e9632 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:13.022453 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4bc07fb6-50c7-4a53-bb0b-46ebb17e9632 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:13.022942 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4bc07fb6-50c7-4a53-bb0b-46ebb17e9632 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:13.052750 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4bc07fb6-50c7-4a53-bb0b-46ebb17e9632 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/9fe7b62b-623e-46c4-9b2d-2c744c2b3512/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043706 Jun 16 12:35:13.053481 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 440/871] 10.222.0.45 () {58 vars in 1301 bytes} [Thu Jun 16 12:35:13 2022] GET /compute/v2.1/servers/9fe7b62b-623e-46c4-9b2d-2c744c2b3512/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:35:13.572712 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-591f4b10-13ad-4d86-b68a-0c99c13cef60 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:35:13.573421 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-591f4b10-13ad-4d86-b68a-0c99c13cef60 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:13.579942 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-591f4b10-13ad-4d86-b68a-0c99c13cef60 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:13.580386 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-591f4b10-13ad-4d86-b68a-0c99c13cef60 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:13.581157 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-591f4b10-13ad-4d86-b68a-0c99c13cef60 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:13.581588 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-591f4b10-13ad-4d86-b68a-0c99c13cef60 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:13.716473 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-591f4b10-13ad-4d86-b68a-0c99c13cef60 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:13.724989 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-591f4b10-13ad-4d86-b68a-0c99c13cef60 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:13.726514 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-591f4b10-13ad-4d86-b68a-0c99c13cef60 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:13.727711 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-591f4b10-13ad-4d86-b68a-0c99c13cef60 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 200 len: 1744 microversion: 2.20 time: 0.160322 Jun 16 12:35:13.728282 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 432/872] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:35:13 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 1744 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:35:14.064091 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-381c962f-1506-4939-99b6-3b84d917e426 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:35:14.064932 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-381c962f-1506-4939-99b6-3b84d917e426 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9fe7b62b-623e-46c4-9b2d-2c744c2b3512] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:14.071413 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-381c962f-1506-4939-99b6-3b84d917e426 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:14.071862 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-381c962f-1506-4939-99b6-3b84d917e426 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:14.072745 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-381c962f-1506-4939-99b6-3b84d917e426 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:14.073183 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-381c962f-1506-4939-99b6-3b84d917e426 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:14.100252 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-381c962f-1506-4939-99b6-3b84d917e426 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/9fe7b62b-623e-46c4-9b2d-2c744c2b3512/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040203 Jun 16 12:35:14.100797 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 441/873] 10.222.0.45 () {58 vars in 1301 bytes} [Thu Jun 16 12:35:14 2022] GET /compute/v2.1/servers/9fe7b62b-623e-46c4-9b2d-2c744c2b3512/os-volume_attachments => generated 25 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 12:35:14.156716 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e7a66ac7-de27-4f14-a0b9-931fccd659b1 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:35:14.157607 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e7a66ac7-de27-4f14-a0b9-931fccd659b1 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9fe7b62b-623e-46c4-9b2d-2c744c2b3512] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:14.163236 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e7a66ac7-de27-4f14-a0b9-931fccd659b1 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:14.163680 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e7a66ac7-de27-4f14-a0b9-931fccd659b1 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:14.164435 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e7a66ac7-de27-4f14-a0b9-931fccd659b1 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:14.164873 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e7a66ac7-de27-4f14-a0b9-931fccd659b1 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:14.189388 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e7a66ac7-de27-4f14-a0b9-931fccd659b1 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9fe7b62b-623e-46c4-9b2d-2c744c2b3512] Going to try to terminate instance {{(pid=117606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 12:35:14.261805 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e7a66ac7-de27-4f14-a0b9-931fccd659b1 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "DELETE /compute/v2.1/servers/9fe7b62b-623e-46c4-9b2d-2c744c2b3512" status: 204 len: 0 microversion: 2.1 time: 0.108838 Jun 16 12:35:14.262424 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 433/874] 10.222.0.45 () {58 vars in 1238 bytes} [Thu Jun 16 12:35:14 2022] DELETE /compute/v2.1/servers/9fe7b62b-623e-46c4-9b2d-2c744c2b3512 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 12:35:14.272037 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f41c223b-2dfc-4d1e-b66a-ac71c9bd13a2 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:35:14.272779 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f41c223b-2dfc-4d1e-b66a-ac71c9bd13a2 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9fe7b62b-623e-46c4-9b2d-2c744c2b3512] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:14.279810 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f41c223b-2dfc-4d1e-b66a-ac71c9bd13a2 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:14.280244 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f41c223b-2dfc-4d1e-b66a-ac71c9bd13a2 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:14.281007 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f41c223b-2dfc-4d1e-b66a-ac71c9bd13a2 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:14.281442 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f41c223b-2dfc-4d1e-b66a-ac71c9bd13a2 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:14.414616 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f41c223b-2dfc-4d1e-b66a-ac71c9bd13a2 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:14.422596 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f41c223b-2dfc-4d1e-b66a-ac71c9bd13a2 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/9fe7b62b-623e-46c4-9b2d-2c744c2b3512" status: 200 len: 1680 microversion: 2.1 time: 0.155411 Jun 16 12:35:14.423149 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 442/875] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:35:14 2022] GET /compute/v2.1/servers/9fe7b62b-623e-46c4-9b2d-2c744c2b3512 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:35:14.747996 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c32d5d3a-a5fe-4642-bf03-6c616a8649fa tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:35:14.748695 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c32d5d3a-a5fe-4642-bf03-6c616a8649fa tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:14.755267 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c32d5d3a-a5fe-4642-bf03-6c616a8649fa tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:14.755718 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c32d5d3a-a5fe-4642-bf03-6c616a8649fa tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:14.756484 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c32d5d3a-a5fe-4642-bf03-6c616a8649fa tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:14.756979 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c32d5d3a-a5fe-4642-bf03-6c616a8649fa tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:14.886991 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c32d5d3a-a5fe-4642-bf03-6c616a8649fa tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:14.895863 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c32d5d3a-a5fe-4642-bf03-6c616a8649fa tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:14.897614 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c32d5d3a-a5fe-4642-bf03-6c616a8649fa tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:14.899275 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c32d5d3a-a5fe-4642-bf03-6c616a8649fa tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 200 len: 1744 microversion: 2.20 time: 0.156327 Jun 16 12:35:14.899750 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 434/876] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:35:14 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:35:15.440686 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5aa420f0-beca-4b59-9658-41521837b2a4 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:35:15.441301 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5aa420f0-beca-4b59-9658-41521837b2a4 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9fe7b62b-623e-46c4-9b2d-2c744c2b3512] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:15.448437 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5aa420f0-beca-4b59-9658-41521837b2a4 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:15.448877 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5aa420f0-beca-4b59-9658-41521837b2a4 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:15.449629 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5aa420f0-beca-4b59-9658-41521837b2a4 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:15.450084 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5aa420f0-beca-4b59-9658-41521837b2a4 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:15.581546 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5aa420f0-beca-4b59-9658-41521837b2a4 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:15.589148 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5aa420f0-beca-4b59-9658-41521837b2a4 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/9fe7b62b-623e-46c4-9b2d-2c744c2b3512" status: 200 len: 1680 microversion: 2.1 time: 0.152339 Jun 16 12:35:15.589716 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 443/877] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:35:15 2022] GET /compute/v2.1/servers/9fe7b62b-623e-46c4-9b2d-2c744c2b3512 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:35:15.918056 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d2b1bfdc-2198-4acd-a7a6-f26219d08783 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:35:15.918696 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d2b1bfdc-2198-4acd-a7a6-f26219d08783 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:15.925135 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d2b1bfdc-2198-4acd-a7a6-f26219d08783 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:15.925576 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d2b1bfdc-2198-4acd-a7a6-f26219d08783 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:15.926359 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d2b1bfdc-2198-4acd-a7a6-f26219d08783 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:15.926796 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d2b1bfdc-2198-4acd-a7a6-f26219d08783 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:16.053164 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d2b1bfdc-2198-4acd-a7a6-f26219d08783 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:16.061908 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d2b1bfdc-2198-4acd-a7a6-f26219d08783 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:16.063387 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d2b1bfdc-2198-4acd-a7a6-f26219d08783 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:16.064531 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d2b1bfdc-2198-4acd-a7a6-f26219d08783 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 200 len: 1744 microversion: 2.20 time: 0.150879 Jun 16 12:35:16.065089 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 435/878] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:35:15 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 1744 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:35:16.607682 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c9ad733f-d67b-4b3e-9a8b-d4b4a034c553 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:35:16.608237 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c9ad733f-d67b-4b3e-9a8b-d4b4a034c553 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9fe7b62b-623e-46c4-9b2d-2c744c2b3512] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:16.614611 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c9ad733f-d67b-4b3e-9a8b-d4b4a034c553 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:16.615057 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c9ad733f-d67b-4b3e-9a8b-d4b4a034c553 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:16.615811 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c9ad733f-d67b-4b3e-9a8b-d4b4a034c553 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:16.616245 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c9ad733f-d67b-4b3e-9a8b-d4b4a034c553 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:16.789027 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c9ad733f-d67b-4b3e-9a8b-d4b4a034c553 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:16.799486 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c9ad733f-d67b-4b3e-9a8b-d4b4a034c553 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/9fe7b62b-623e-46c4-9b2d-2c744c2b3512" status: 200 len: 1680 microversion: 2.1 time: 0.196553 Jun 16 12:35:16.800062 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 444/879] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:35:16 2022] GET /compute/v2.1/servers/9fe7b62b-623e-46c4-9b2d-2c744c2b3512 => generated 1680 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:35:16.829127 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-73aa69c3-1725-4c0a-b863-ac313ffe8052 req-03188181-68c5-4121-90bc-2078758b2447 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f50c08e9-d310-424a-972c-1c16733a796e", "name": "network-vif-plugged", "status": "completed", "tag": "54891bff-8bc6-48af-8125-5099eafe66f7"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:35:16.839538 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-73aa69c3-1725-4c0a-b863-ac313ffe8052 req-03188181-68c5-4121-90bc-2078758b2447 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:16.840672 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-73aa69c3-1725-4c0a-b863-ac313ffe8052 req-03188181-68c5-4121-90bc-2078758b2447 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:16.846929 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:35:16.857460 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-73aa69c3-1725-4c0a-b863-ac313ffe8052 req-03188181-68c5-4121-90bc-2078758b2447 service nova] Creating event network-vif-plugged:54891bff-8bc6-48af-8125-5099eafe66f7 for instance f50c08e9-d310-424a-972c-1c16733a796e on hv-cinder-84614 Jun 16 12:35:16.863794 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-73aa69c3-1725-4c0a-b863-ac313ffe8052 req-03188181-68c5-4121-90bc-2078758b2447 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039263 Jun 16 12:35:16.864627 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 436/880] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:35:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 12:35:17.083367 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-65f07214-f1ce-4708-93ad-6fc2fb41fca3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:35:17.083985 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-65f07214-f1ce-4708-93ad-6fc2fb41fca3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:17.090120 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-65f07214-f1ce-4708-93ad-6fc2fb41fca3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:17.090572 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-65f07214-f1ce-4708-93ad-6fc2fb41fca3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:17.091340 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-65f07214-f1ce-4708-93ad-6fc2fb41fca3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:17.091774 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-65f07214-f1ce-4708-93ad-6fc2fb41fca3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:17.292204 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-65f07214-f1ce-4708-93ad-6fc2fb41fca3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:17.300774 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-65f07214-f1ce-4708-93ad-6fc2fb41fca3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:17.302319 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-65f07214-f1ce-4708-93ad-6fc2fb41fca3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:17.303484 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-65f07214-f1ce-4708-93ad-6fc2fb41fca3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 200 len: 1744 microversion: 2.20 time: 0.223960 Jun 16 12:35:17.304047 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 445/881] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:35:17 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 1744 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:35:17.641854 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-87a8305c-0f99-4f02-be8e-191993b7eef8 req-0b9d0ef0-e61b-4090-884d-281f858ccad2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fe7b62b-623e-46c4-9b2d-2c744c2b3512", "name": "network-vif-deleted", "tag": "b739847a-8a47-4ad0-87ce-05ff1725ccd3"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:35:17.652680 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-87a8305c-0f99-4f02-be8e-191993b7eef8 req-0b9d0ef0-e61b-4090-884d-281f858ccad2 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:17.653021 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-87a8305c-0f99-4f02-be8e-191993b7eef8 req-0b9d0ef0-e61b-4090-884d-281f858ccad2 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:17.664530 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-87a8305c-0f99-4f02-be8e-191993b7eef8 req-0b9d0ef0-e61b-4090-884d-281f858ccad2 service nova] Creating event network-vif-deleted:b739847a-8a47-4ad0-87ce-05ff1725ccd3 for instance 9fe7b62b-623e-46c4-9b2d-2c744c2b3512 on hv-cinder-84614 Jun 16 12:35:17.671036 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-87a8305c-0f99-4f02-be8e-191993b7eef8 req-0b9d0ef0-e61b-4090-884d-281f858ccad2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034350 Jun 16 12:35:17.671666 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 437/882] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:35:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:35:17.816925 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4919a1c6-434b-4d63-ad4a-2f95b67cffb1 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:35:17.818164 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4919a1c6-434b-4d63-ad4a-2f95b67cffb1 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9fe7b62b-623e-46c4-9b2d-2c744c2b3512] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:17.827477 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4919a1c6-434b-4d63-ad4a-2f95b67cffb1 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:17.828356 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4919a1c6-434b-4d63-ad4a-2f95b67cffb1 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:17.829575 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4919a1c6-434b-4d63-ad4a-2f95b67cffb1 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:17.830320 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4919a1c6-434b-4d63-ad4a-2f95b67cffb1 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:17.870316 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4919a1c6-434b-4d63-ad4a-2f95b67cffb1 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:17.871095 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4919a1c6-434b-4d63-ad4a-2f95b67cffb1 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:17.871805 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.objects.instance [None req-4919a1c6-434b-4d63-ad4a-2f95b67cffb1 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lazy-loading 'fault' on Instance uuid 9fe7b62b-623e-46c4-9b2d-2c744c2b3512 {{(pid=117607) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 12:35:17.921555 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4919a1c6-434b-4d63-ad4a-2f95b67cffb1 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:17.930050 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4919a1c6-434b-4d63-ad4a-2f95b67cffb1 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/9fe7b62b-623e-46c4-9b2d-2c744c2b3512" status: 200 len: 1330 microversion: 2.1 time: 0.117317 Jun 16 12:35:17.930791 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 446/883] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:35:17 2022] GET /compute/v2.1/servers/9fe7b62b-623e-46c4-9b2d-2c744c2b3512 => generated 1330 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:35:18.323506 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9e79cd26-5c07-42a6-86cb-0a7214b5111c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:35:18.324294 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9e79cd26-5c07-42a6-86cb-0a7214b5111c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:18.330723 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9e79cd26-5c07-42a6-86cb-0a7214b5111c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:18.331272 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9e79cd26-5c07-42a6-86cb-0a7214b5111c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:18.331927 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9e79cd26-5c07-42a6-86cb-0a7214b5111c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:18.332363 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9e79cd26-5c07-42a6-86cb-0a7214b5111c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:18.479193 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9e79cd26-5c07-42a6-86cb-0a7214b5111c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:18.488551 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9e79cd26-5c07-42a6-86cb-0a7214b5111c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:18.490261 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9e79cd26-5c07-42a6-86cb-0a7214b5111c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:18.491739 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9e79cd26-5c07-42a6-86cb-0a7214b5111c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 200 len: 1744 microversion: 2.20 time: 0.172543 Jun 16 12:35:18.492381 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 438/884] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:35:18 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 1744 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:35:18.947809 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c9043e56-32c9-4816-ba76-2501c040bc7f tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:35:18.948419 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c9043e56-32c9-4816-ba76-2501c040bc7f tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9fe7b62b-623e-46c4-9b2d-2c744c2b3512] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:18.954865 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c9043e56-32c9-4816-ba76-2501c040bc7f tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:18.955311 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c9043e56-32c9-4816-ba76-2501c040bc7f tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:18.956068 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c9043e56-32c9-4816-ba76-2501c040bc7f tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:18.956501 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c9043e56-32c9-4816-ba76-2501c040bc7f tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:18.970160 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-c9043e56-32c9-4816-ba76-2501c040bc7f tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] HTTP exception thrown: Instance 9fe7b62b-623e-46c4-9b2d-2c744c2b3512 could not be found. Jun 16 12:35:18.971656 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c9043e56-32c9-4816-ba76-2501c040bc7f tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Request method failure captured: Jun 16 12:35:18.971656 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: request: GET /compute/v2.1/servers/9fe7b62b-623e-46c4-9b2d-2c744c2b3512 HTTP/1.1 Jun 16 12:35:18.971656 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Accept: application/json Jun 16 12:35:18.971656 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jun 16 12:35:18.971656 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Connection: close Jun 16 12:35:18.971656 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jun 16 12:35:18.971656 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jun 16 12:35:18.971656 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Host: 10.222.0.45 Jun 16 12:35:18.971656 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jun 16 12:35:18.971656 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jun 16 12:35:18.971656 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABiqyGF1I7NNsn9N-NNLw8e7JwWQfFAz21t9AN_OlEcHKfvG-zVtCE3h0xqQLPiYlGgCbqHJIMx6mphLTjEkYrptZmSsukd0-SUbPj3ipfsUXouJgw4LZCCngD_KxZq-5FKd9EOmAaCBK7p8lhdHrTX3rZ5m9BxXUJmHDIk-Sxu6p9pH_c Jun 16 12:35:18.971656 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jun 16 12:35:18.971656 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jun 16 12:35:18.971656 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jun 16 12:35:18.971656 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jun 16 12:35:18.971656 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jun 16 12:35:18.971656 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jun 16 12:35:18.971656 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Id: 3fce886a9a894240a0b3bd3af94d2465 Jun 16 12:35:18.971656 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-AttachVolumeNegativeTest-1612233326 Jun 16 12:35:18.971656 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Role: member,reader Jun 16 12:35:18.971656 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Roles: member,reader Jun 16 12:35:18.973198 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3fce886a9a894240a0b3bd3af94d2465"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3fce886a9a894240a0b3bd3af94d2465"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3fce886a9a894240a0b3bd3af94d2465"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3fce886a9a894240a0b3bd3af94d2465"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Jun 16 12:35:18.973198 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-AttachVolumeNegativeTest-1612233326 Jun 16 12:35:18.973198 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant-Id: 3fce886a9a894240a0b3bd3af94d2465 Jun 16 12:35:18.973198 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1612233326 Jun 16 12:35:18.973198 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User: tempest-AttachVolumeNegativeTest-1612233326-project Jun 16 12:35:18.973198 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jun 16 12:35:18.973198 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jun 16 12:35:18.973198 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Id: ed6b630c60d640afb1325215ea27acef Jun 16 12:35:18.973198 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-AttachVolumeNegativeTest-1612233326-project Jun 16 12:35:18.973198 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: method: > Jun 16 12:35:18.973198 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: exception: Instance 9fe7b62b-623e-46c4-9b2d-2c744c2b3512 could not be found. Jun 16 12:35:18.973198 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: action_args: {'id': '9fe7b62b-623e-46c4-9b2d-2c744c2b3512'} Jun 16 12:35:18.974159 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:35:18.974159 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:35:18.974159 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:35:18.974159 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:35:18.974159 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:35:18.974159 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:35:18.974159 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:35:18.974159 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:35:18.974159 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:35:18.974159 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:35:18.974159 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fe7b62b-623e-46c4-9b2d-2c744c2b3512 could not be found. Jun 16 12:35:18.974159 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:35:18.974159 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:35:18.974159 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:35:18.974159 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:35:18.974159 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:35:18.974159 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:35:18.974159 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:35:18.974159 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:35:18.974159 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:35:18.975609 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:35:18.975609 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 12:35:18.975609 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 12:35:18.975609 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:35:18.975609 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:35:18.975609 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:35:18.975609 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:35:18.975609 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fe7b62b-623e-46c4-9b2d-2c744c2b3512 could not be found. Jun 16 12:35:18.975609 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:35:18.975609 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:35:18.975609 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:35:18.975609 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:35:18.975609 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:35:18.975609 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:35:18.975609 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:35:18.975609 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:35:18.975609 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fe7b62b-623e-46c4-9b2d-2c744c2b3512 could not be found. Jun 16 12:35:18.975609 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:35:18.976903 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c9043e56-32c9-4816-ba76-2501c040bc7f tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Returning 404 to user: Instance 9fe7b62b-623e-46c4-9b2d-2c744c2b3512 could not be found. {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:35:18.976903 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c9043e56-32c9-4816-ba76-2501c040bc7f tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/9fe7b62b-623e-46c4-9b2d-2c744c2b3512" status: 404 len: 111 microversion: 2.1 time: 0.029218 Jun 16 12:35:18.976903 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 447/885] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:35:18 2022] GET /compute/v2.1/servers/9fe7b62b-623e-46c4-9b2d-2c744c2b3512 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 12:35:18.982377 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-bf623331-0444-4a33-a0f8-7fade097292e tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '.version_select at 0x7f7c72086040>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:35:18.999935 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-bf623331-0444-4a33-a0f8-7fade097292e tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-106645397" status: 202 len: 0 microversion: 2.1 time: 0.022070 Jun 16 12:35:19.000490 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 439/886] 10.222.0.45 () {58 vars in 1217 bytes} [Thu Jun 16 12:35:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-106645397 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 12:35:19.513825 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a1fb8103-7ffb-4dd5-9bd2-6eb76c8ce16c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:35:19.515143 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a1fb8103-7ffb-4dd5-9bd2-6eb76c8ce16c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:19.521552 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a1fb8103-7ffb-4dd5-9bd2-6eb76c8ce16c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:19.522206 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a1fb8103-7ffb-4dd5-9bd2-6eb76c8ce16c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:19.523095 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a1fb8103-7ffb-4dd5-9bd2-6eb76c8ce16c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:19.523744 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a1fb8103-7ffb-4dd5-9bd2-6eb76c8ce16c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:19.529441 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:35:19.817917 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a1fb8103-7ffb-4dd5-9bd2-6eb76c8ce16c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:19.826623 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a1fb8103-7ffb-4dd5-9bd2-6eb76c8ce16c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:19.828211 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a1fb8103-7ffb-4dd5-9bd2-6eb76c8ce16c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:19.829320 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a1fb8103-7ffb-4dd5-9bd2-6eb76c8ce16c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 200 len: 1739 microversion: 2.20 time: 0.320712 Jun 16 12:35:19.840538 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 448/887] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:35:19 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 1739 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:35:19.984099 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e70895c2-a98a-4db9-b9e4-d1abb97ce19a tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Action: 'create', calling method: .version_select at 0x7f7c720823a0>, body: {"keypair": {"name": "tempest-keypair-806194570", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJqBGhzdw8bECMkRw39bPbV2WoLx7Ne2IolVZ7cK/q+XQyCyEL9B2ex9L24Im28de1GkpwaZhPIk1a/MuK2wUyWlmWS4TxdWvw2wIKaHUr0QF5asSHAto8gWFulXbmuilw=="}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:35:20.000337 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-e70895c2-a98a-4db9-b9e4-d1abb97ce19a tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Getting quotas for project 3fce886a9a894240a0b3bd3af94d2465. Resources: {'key_pairs'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 12:35:20.004291 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-e70895c2-a98a-4db9-b9e4-d1abb97ce19a tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Getting quotas for user ed6b630c60d640afb1325215ea27acef and project 3fce886a9a894240a0b3bd3af94d2465. Resources: {'key_pairs'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 12:35:20.030965 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e70895c2-a98a-4db9-b9e4-d1abb97ce19a tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.050635 Jun 16 12:35:20.036709 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 440/888] 10.222.0.45 () {60 vars in 1158 bytes} [Thu Jun 16 12:35:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:35:20.849058 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-68359064-04f4-499d-b894-a800e5afe136 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:35:20.849968 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-68359064-04f4-499d-b894-a800e5afe136 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:20.857336 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-68359064-04f4-499d-b894-a800e5afe136 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:20.858077 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-68359064-04f4-499d-b894-a800e5afe136 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:20.859039 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-68359064-04f4-499d-b894-a800e5afe136 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:20.859633 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-68359064-04f4-499d-b894-a800e5afe136 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:21.010473 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-68359064-04f4-499d-b894-a800e5afe136 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:21.024073 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-68359064-04f4-499d-b894-a800e5afe136 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:21.026903 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-68359064-04f4-499d-b894-a800e5afe136 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:21.028607 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-68359064-04f4-499d-b894-a800e5afe136 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 200 len: 1739 microversion: 2.20 time: 0.183768 Jun 16 12:35:21.029497 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 449/889] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:35:20 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 1739 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:35:21.586066 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-52a7dd0a-aee2-46f5-ae8e-96d1d14ee75a tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-729979926", "imageRef": "c736a2d2-9d0d-41ec-b9fc-971428b0ff7a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "151a2bee-6229-46e8-95f9-7544fde552a8"}], "security_groups": [{"name": "tempest-securitygroup--382411011"}], "key_name": "tempest-keypair-806194570", "user_data": "}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:35:21.710948 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.network.neutron [None req-52a7dd0a-aee2-46f5-ae8e-96d1d14ee75a tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] validate_networks() for [('151a2bee-6229-46e8-95f9-7544fde552a8', None, None, None, None, None)] {{(pid=117606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 12:35:22.048502 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f53dfa82-c589-4e79-b549-8631aab20f80 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:35:22.049296 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f53dfa82-c589-4e79-b549-8631aab20f80 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:22.058118 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f53dfa82-c589-4e79-b549-8631aab20f80 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:22.058905 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f53dfa82-c589-4e79-b549-8631aab20f80 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:22.060522 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f53dfa82-c589-4e79-b549-8631aab20f80 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:22.061177 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f53dfa82-c589-4e79-b549-8631aab20f80 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:22.199112 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-52a7dd0a-aee2-46f5-ae8e-96d1d14ee75a tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Flavor limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 12:35:22.199814 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-52a7dd0a-aee2-46f5-ae8e-96d1d14ee75a tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Image limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 12:35:22.200505 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-52a7dd0a-aee2-46f5-ae8e-96d1d14ee75a tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Flavor pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 12:35:22.201614 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-52a7dd0a-aee2-46f5-ae8e-96d1d14ee75a tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Image pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 12:35:22.202293 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-52a7dd0a-aee2-46f5-ae8e-96d1d14ee75a tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 12:35:22.216009 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-52a7dd0a-aee2-46f5-ae8e-96d1d14ee75a tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:22.217235 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-52a7dd0a-aee2-46f5-ae8e-96d1d14ee75a tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:22.218323 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-52a7dd0a-aee2-46f5-ae8e-96d1d14ee75a tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:22.218997 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-52a7dd0a-aee2-46f5-ae8e-96d1d14ee75a tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:22.243075 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-52a7dd0a-aee2-46f5-ae8e-96d1d14ee75a tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Getting quotas for project 3fce886a9a894240a0b3bd3af94d2465. Resources: {'instances', 'cores', 'ram'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 12:35:22.248272 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-52a7dd0a-aee2-46f5-ae8e-96d1d14ee75a tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Getting quotas for user ed6b630c60d640afb1325215ea27acef and project 3fce886a9a894240a0b3bd3af94d2465. Resources: {'instances', 'cores', 'ram'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 12:35:22.263626 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-52a7dd0a-aee2-46f5-ae8e-96d1d14ee75a tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Going to run 1 instances... {{(pid=117606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 12:35:22.264176 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f53dfa82-c589-4e79-b549-8631aab20f80 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:22.265976 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-52a7dd0a-aee2-46f5-ae8e-96d1d14ee75a tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: a3051ffe-ff68-4737-9838-12cb61b509a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c736a2d2-9d0d-41ec-b9fc-971428b0ff7a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 12:35:22.273271 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f53dfa82-c589-4e79-b549-8631aab20f80 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:22.276978 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f53dfa82-c589-4e79-b549-8631aab20f80 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:22.278928 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f53dfa82-c589-4e79-b549-8631aab20f80 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 200 len: 1739 microversion: 2.20 time: 0.234815 Jun 16 12:35:22.280857 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 450/890] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:35:22 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 1739 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:35:22.317002 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-52a7dd0a-aee2-46f5-ae8e-96d1d14ee75a tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.735776 Jun 16 12:35:22.317760 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 441/891] 10.222.0.45 () {60 vars in 1146 bytes} [Thu Jun 16 12:35:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 12:35:22.328653 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a2978a03-5412-451f-b4f9-4d972c159c39 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:35:22.329705 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a2978a03-5412-451f-b4f9-4d972c159c39 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: a3051ffe-ff68-4737-9838-12cb61b509a8] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:22.414206 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a2978a03-5412-451f-b4f9-4d972c159c39 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:22.424916 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a2978a03-5412-451f-b4f9-4d972c159c39 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/a3051ffe-ff68-4737-9838-12cb61b509a8" status: 200 len: 1240 microversion: 2.1 time: 0.099429 Jun 16 12:35:22.426193 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 451/892] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:35:22 2022] GET /compute/v2.1/servers/a3051ffe-ff68-4737-9838-12cb61b509a8 => generated 1240 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:35:23.297989 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b53dab72-2348-4a01-9e09-368e5d67706b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:35:23.299384 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b53dab72-2348-4a01-9e09-368e5d67706b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:23.306140 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b53dab72-2348-4a01-9e09-368e5d67706b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:23.306954 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b53dab72-2348-4a01-9e09-368e5d67706b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:23.307818 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b53dab72-2348-4a01-9e09-368e5d67706b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:23.308531 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b53dab72-2348-4a01-9e09-368e5d67706b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:23.443988 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-86435965-4f47-46e0-aa85-5e4b31f69054 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:35:23.445478 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-86435965-4f47-46e0-aa85-5e4b31f69054 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: a3051ffe-ff68-4737-9838-12cb61b509a8] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:23.453124 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-86435965-4f47-46e0-aa85-5e4b31f69054 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:23.454442 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-86435965-4f47-46e0-aa85-5e4b31f69054 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:23.455663 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-86435965-4f47-46e0-aa85-5e4b31f69054 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:23.456326 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-86435965-4f47-46e0-aa85-5e4b31f69054 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:23.549638 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-86435965-4f47-46e0-aa85-5e4b31f69054 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:23.561089 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-86435965-4f47-46e0-aa85-5e4b31f69054 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/a3051ffe-ff68-4737-9838-12cb61b509a8" status: 200 len: 1300 microversion: 2.1 time: 0.121545 Jun 16 12:35:23.561891 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 452/893] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:35:23 2022] GET /compute/v2.1/servers/a3051ffe-ff68-4737-9838-12cb61b509a8 => generated 1300 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:35:23.573732 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b53dab72-2348-4a01-9e09-368e5d67706b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:23.591920 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b53dab72-2348-4a01-9e09-368e5d67706b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:23.593782 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b53dab72-2348-4a01-9e09-368e5d67706b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:23.595431 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b53dab72-2348-4a01-9e09-368e5d67706b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 200 len: 1739 microversion: 2.20 time: 0.302036 Jun 16 12:35:23.596639 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 442/894] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:35:23 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 1739 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:35:24.582293 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-dbc5a2bf-ae98-49b7-bb13-f440657050a4 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:35:24.584121 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-dbc5a2bf-ae98-49b7-bb13-f440657050a4 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: a3051ffe-ff68-4737-9838-12cb61b509a8] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:24.593340 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dbc5a2bf-ae98-49b7-bb13-f440657050a4 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:24.594385 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dbc5a2bf-ae98-49b7-bb13-f440657050a4 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:24.596004 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dbc5a2bf-ae98-49b7-bb13-f440657050a4 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:24.596786 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dbc5a2bf-ae98-49b7-bb13-f440657050a4 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:24.614172 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-602e7949-7be7-4ee1-ac67-815ba7f9ec45 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:35:24.614783 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-602e7949-7be7-4ee1-ac67-815ba7f9ec45 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:24.627197 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-602e7949-7be7-4ee1-ac67-815ba7f9ec45 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:24.627653 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-602e7949-7be7-4ee1-ac67-815ba7f9ec45 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:24.628433 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-602e7949-7be7-4ee1-ac67-815ba7f9ec45 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:24.628873 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-602e7949-7be7-4ee1-ac67-815ba7f9ec45 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:24.944110 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-dbc5a2bf-ae98-49b7-bb13-f440657050a4 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:24.953342 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-dbc5a2bf-ae98-49b7-bb13-f440657050a4 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/a3051ffe-ff68-4737-9838-12cb61b509a8" status: 200 len: 1365 microversion: 2.1 time: 0.378142 Jun 16 12:35:24.953847 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-602e7949-7be7-4ee1-ac67-815ba7f9ec45 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:24.964855 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 453/895] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:35:24 2022] GET /compute/v2.1/servers/a3051ffe-ff68-4737-9838-12cb61b509a8 => generated 1365 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:35:24.974195 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-602e7949-7be7-4ee1-ac67-815ba7f9ec45 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:24.976610 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-602e7949-7be7-4ee1-ac67-815ba7f9ec45 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:24.979513 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-602e7949-7be7-4ee1-ac67-815ba7f9ec45 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 200 len: 1739 microversion: 2.20 time: 0.367623 Jun 16 12:35:24.980651 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 443/896] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:35:24 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 1739 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 12:35:25.432916 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-03fa47f5-3595-4733-9aff-f7356d54520e req-7941e9b5-57ff-4cba-87ea-7c674f78c3ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3051ffe-ff68-4737-9838-12cb61b509a8", "tag": "da76e069-6a47-4f2c-b606-30c8b95c40c7"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:35:25.446113 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-03fa47f5-3595-4733-9aff-f7356d54520e req-7941e9b5-57ff-4cba-87ea-7c674f78c3ba service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:25.446577 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-03fa47f5-3595-4733-9aff-f7356d54520e req-7941e9b5-57ff-4cba-87ea-7c674f78c3ba service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:25.477482 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-03fa47f5-3595-4733-9aff-f7356d54520e req-7941e9b5-57ff-4cba-87ea-7c674f78c3ba service nova] Creating event network-changed:da76e069-6a47-4f2c-b606-30c8b95c40c7 for instance a3051ffe-ff68-4737-9838-12cb61b509a8 on hv-cinder-84614 Jun 16 12:35:25.489515 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-03fa47f5-3595-4733-9aff-f7356d54520e req-7941e9b5-57ff-4cba-87ea-7c674f78c3ba service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061656 Jun 16 12:35:25.490266 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 454/897] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:35:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:35:25.972607 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a32f9a2e-b85d-4b3e-9591-ec852075b706 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:35:25.973955 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a32f9a2e-b85d-4b3e-9591-ec852075b706 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: a3051ffe-ff68-4737-9838-12cb61b509a8] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:25.981597 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a32f9a2e-b85d-4b3e-9591-ec852075b706 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:25.982089 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a32f9a2e-b85d-4b3e-9591-ec852075b706 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:25.982870 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a32f9a2e-b85d-4b3e-9591-ec852075b706 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:25.983314 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a32f9a2e-b85d-4b3e-9591-ec852075b706 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:26.003348 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-87cb2153-7454-4541-8573-5ca1e4713046 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:35:26.010800 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-87cb2153-7454-4541-8573-5ca1e4713046 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:26.018371 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-87cb2153-7454-4541-8573-5ca1e4713046 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:26.019137 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-87cb2153-7454-4541-8573-5ca1e4713046 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:26.020270 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-87cb2153-7454-4541-8573-5ca1e4713046 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:26.020906 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-87cb2153-7454-4541-8573-5ca1e4713046 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:26.191918 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a32f9a2e-b85d-4b3e-9591-ec852075b706 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:26.201805 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a32f9a2e-b85d-4b3e-9591-ec852075b706 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/a3051ffe-ff68-4737-9838-12cb61b509a8" status: 200 len: 1365 microversion: 2.1 time: 0.233260 Jun 16 12:35:26.202725 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 444/898] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:35:25 2022] GET /compute/v2.1/servers/a3051ffe-ff68-4737-9838-12cb61b509a8 => generated 1365 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:35:26.227262 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-87cb2153-7454-4541-8573-5ca1e4713046 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:26.240504 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-87cb2153-7454-4541-8573-5ca1e4713046 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:26.242506 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-87cb2153-7454-4541-8573-5ca1e4713046 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:26.244067 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-87cb2153-7454-4541-8573-5ca1e4713046 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 200 len: 1739 microversion: 2.20 time: 0.247452 Jun 16 12:35:26.254786 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 455/899] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:35:25 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 1739 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:35:27.223092 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-042565a4-b9e0-49ee-8d2e-99de58266766 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:35:27.223800 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-042565a4-b9e0-49ee-8d2e-99de58266766 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: a3051ffe-ff68-4737-9838-12cb61b509a8] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:27.232839 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-042565a4-b9e0-49ee-8d2e-99de58266766 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:27.233548 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-042565a4-b9e0-49ee-8d2e-99de58266766 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:27.234595 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-042565a4-b9e0-49ee-8d2e-99de58266766 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:27.235197 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-042565a4-b9e0-49ee-8d2e-99de58266766 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:27.303463 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4c92b38e-dc29-45b4-8dff-cb3e79205e83 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:35:27.305169 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4c92b38e-dc29-45b4-8dff-cb3e79205e83 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:27.313298 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4c92b38e-dc29-45b4-8dff-cb3e79205e83 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:27.313833 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4c92b38e-dc29-45b4-8dff-cb3e79205e83 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:27.314697 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4c92b38e-dc29-45b4-8dff-cb3e79205e83 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:27.315212 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4c92b38e-dc29-45b4-8dff-cb3e79205e83 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:27.431432 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-042565a4-b9e0-49ee-8d2e-99de58266766 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:27.443114 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-042565a4-b9e0-49ee-8d2e-99de58266766 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/a3051ffe-ff68-4737-9838-12cb61b509a8" status: 200 len: 1365 microversion: 2.1 time: 0.222689 Jun 16 12:35:27.444437 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 445/900] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:35:27 2022] GET /compute/v2.1/servers/a3051ffe-ff68-4737-9838-12cb61b509a8 => generated 1365 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:35:27.497820 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4c92b38e-dc29-45b4-8dff-cb3e79205e83 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:27.505771 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4c92b38e-dc29-45b4-8dff-cb3e79205e83 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:27.507321 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4c92b38e-dc29-45b4-8dff-cb3e79205e83 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:27.508489 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4c92b38e-dc29-45b4-8dff-cb3e79205e83 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 200 len: 1739 microversion: 2.20 time: 0.236928 Jun 16 12:35:27.509804 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 456/901] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:35:27 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 1739 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:35:28.462065 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-34b93bec-e94f-46bb-ace2-d5fa25e5c6ba tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:35:28.463317 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-34b93bec-e94f-46bb-ace2-d5fa25e5c6ba tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: a3051ffe-ff68-4737-9838-12cb61b509a8] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:28.470563 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-34b93bec-e94f-46bb-ace2-d5fa25e5c6ba tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:28.471026 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-34b93bec-e94f-46bb-ace2-d5fa25e5c6ba tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:28.471806 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-34b93bec-e94f-46bb-ace2-d5fa25e5c6ba tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:28.472241 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-34b93bec-e94f-46bb-ace2-d5fa25e5c6ba tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:28.530375 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7be91231-a4e1-40d2-bdf7-511c94449f67 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:35:28.531365 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7be91231-a4e1-40d2-bdf7-511c94449f67 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:28.538321 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7be91231-a4e1-40d2-bdf7-511c94449f67 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:28.538940 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7be91231-a4e1-40d2-bdf7-511c94449f67 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:28.539892 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7be91231-a4e1-40d2-bdf7-511c94449f67 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:28.540853 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7be91231-a4e1-40d2-bdf7-511c94449f67 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:28.768432 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-34b93bec-e94f-46bb-ace2-d5fa25e5c6ba tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:28.798865 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-34b93bec-e94f-46bb-ace2-d5fa25e5c6ba tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/a3051ffe-ff68-4737-9838-12cb61b509a8" status: 200 len: 1365 microversion: 2.1 time: 0.341412 Jun 16 12:35:28.799690 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 446/902] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:35:28 2022] GET /compute/v2.1/servers/a3051ffe-ff68-4737-9838-12cb61b509a8 => generated 1365 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:35:28.827121 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7be91231-a4e1-40d2-bdf7-511c94449f67 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:28.835092 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7be91231-a4e1-40d2-bdf7-511c94449f67 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:28.836582 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7be91231-a4e1-40d2-bdf7-511c94449f67 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:28.837843 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7be91231-a4e1-40d2-bdf7-511c94449f67 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 200 len: 1739 microversion: 2.20 time: 0.312085 Jun 16 12:35:28.838553 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 457/903] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:35:28 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 1739 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 12:35:29.816510 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2e03191c-abf1-4170-a185-dc0944ad16c7 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:35:29.817125 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2e03191c-abf1-4170-a185-dc0944ad16c7 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: a3051ffe-ff68-4737-9838-12cb61b509a8] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:29.824115 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2e03191c-abf1-4170-a185-dc0944ad16c7 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:29.824564 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2e03191c-abf1-4170-a185-dc0944ad16c7 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:29.825325 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2e03191c-abf1-4170-a185-dc0944ad16c7 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:29.825762 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2e03191c-abf1-4170-a185-dc0944ad16c7 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:29.856658 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3a51eebb-c45c-4c8b-b10d-4adba646d58a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:35:29.857319 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3a51eebb-c45c-4c8b-b10d-4adba646d58a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:29.859755 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=57 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:35:29.865246 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3a51eebb-c45c-4c8b-b10d-4adba646d58a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:29.865692 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3a51eebb-c45c-4c8b-b10d-4adba646d58a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:29.866483 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3a51eebb-c45c-4c8b-b10d-4adba646d58a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:29.866911 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3a51eebb-c45c-4c8b-b10d-4adba646d58a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:29.998405 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2e03191c-abf1-4170-a185-dc0944ad16c7 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:30.005677 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2e03191c-abf1-4170-a185-dc0944ad16c7 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/a3051ffe-ff68-4737-9838-12cb61b509a8" status: 200 len: 1365 microversion: 2.1 time: 0.193010 Jun 16 12:35:30.006265 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 447/904] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:35:29 2022] GET /compute/v2.1/servers/a3051ffe-ff68-4737-9838-12cb61b509a8 => generated 1365 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:35:30.033394 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-3a51eebb-c45c-4c8b-b10d-4adba646d58a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:30.041225 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-3a51eebb-c45c-4c8b-b10d-4adba646d58a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:30.042761 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-3a51eebb-c45c-4c8b-b10d-4adba646d58a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:30.043913 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3a51eebb-c45c-4c8b-b10d-4adba646d58a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 200 len: 1739 microversion: 2.20 time: 0.191639 Jun 16 12:35:30.044467 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 458/905] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:35:29 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 1739 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 12:35:31.022805 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c82b890c-4f36-41b4-ae78-19da6c615f1b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:35:31.023539 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c82b890c-4f36-41b4-ae78-19da6c615f1b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: a3051ffe-ff68-4737-9838-12cb61b509a8] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:31.030348 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c82b890c-4f36-41b4-ae78-19da6c615f1b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:31.030794 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c82b890c-4f36-41b4-ae78-19da6c615f1b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:31.031543 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c82b890c-4f36-41b4-ae78-19da6c615f1b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:31.031979 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c82b890c-4f36-41b4-ae78-19da6c615f1b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:31.062792 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7a1016bd-c363-4646-ab70-51f5c2c9c7da tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:35:31.063323 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7a1016bd-c363-4646-ab70-51f5c2c9c7da tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:31.069851 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7a1016bd-c363-4646-ab70-51f5c2c9c7da tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:31.070358 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7a1016bd-c363-4646-ab70-51f5c2c9c7da tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:31.071133 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7a1016bd-c363-4646-ab70-51f5c2c9c7da tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:31.072354 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7a1016bd-c363-4646-ab70-51f5c2c9c7da tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:31.212895 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c82b890c-4f36-41b4-ae78-19da6c615f1b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:31.221406 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c82b890c-4f36-41b4-ae78-19da6c615f1b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/a3051ffe-ff68-4737-9838-12cb61b509a8" status: 200 len: 1365 microversion: 2.1 time: 0.202431 Jun 16 12:35:31.222004 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 448/906] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:35:31 2022] GET /compute/v2.1/servers/a3051ffe-ff68-4737-9838-12cb61b509a8 => generated 1365 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:35:31.239627 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7a1016bd-c363-4646-ab70-51f5c2c9c7da tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:31.247937 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7a1016bd-c363-4646-ab70-51f5c2c9c7da tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:31.249451 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7a1016bd-c363-4646-ab70-51f5c2c9c7da tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:31.250623 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7a1016bd-c363-4646-ab70-51f5c2c9c7da tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 200 len: 1721 microversion: 2.20 time: 0.191750 Jun 16 12:35:31.251175 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 459/907] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:35:31 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 1721 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 12:35:32.238782 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9ceb1065-0bc9-4142-887c-be28fe3cb0a2 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:35:32.239399 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9ceb1065-0bc9-4142-887c-be28fe3cb0a2 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: a3051ffe-ff68-4737-9838-12cb61b509a8] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:32.241810 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=2 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:35:32.242487 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:35:32.249035 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9ceb1065-0bc9-4142-887c-be28fe3cb0a2 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:32.249484 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9ceb1065-0bc9-4142-887c-be28fe3cb0a2 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:32.250284 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9ceb1065-0bc9-4142-887c-be28fe3cb0a2 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:32.250721 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9ceb1065-0bc9-4142-887c-be28fe3cb0a2 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:32.267424 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=10 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:35:32.270101 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d1931d8a-a579-4cf8-8fc7-bfda5e9b78a2 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:35:32.270836 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d1931d8a-a579-4cf8-8fc7-bfda5e9b78a2 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:32.277782 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d1931d8a-a579-4cf8-8fc7-bfda5e9b78a2 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:32.278527 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d1931d8a-a579-4cf8-8fc7-bfda5e9b78a2 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:32.279302 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d1931d8a-a579-4cf8-8fc7-bfda5e9b78a2 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:32.279739 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d1931d8a-a579-4cf8-8fc7-bfda5e9b78a2 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:32.423467 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell0:SELECT=2 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:35:32.448661 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9ceb1065-0bc9-4142-887c-be28fe3cb0a2 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:32.455137 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d1931d8a-a579-4cf8-8fc7-bfda5e9b78a2 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:32.456116 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9ceb1065-0bc9-4142-887c-be28fe3cb0a2 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/a3051ffe-ff68-4737-9838-12cb61b509a8" status: 200 len: 1365 microversion: 2.1 time: 0.221100 Jun 16 12:35:32.456696 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 449/908] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:35:32 2022] GET /compute/v2.1/servers/a3051ffe-ff68-4737-9838-12cb61b509a8 => generated 1365 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:35:32.464217 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d1931d8a-a579-4cf8-8fc7-bfda5e9b78a2 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:32.465752 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d1931d8a-a579-4cf8-8fc7-bfda5e9b78a2 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:32.467166 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d1931d8a-a579-4cf8-8fc7-bfda5e9b78a2 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 200 len: 1721 microversion: 2.20 time: 0.201067 Jun 16 12:35:32.467758 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 460/909] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:35:32 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 1721 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 12:35:32.855687 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-a776173c-2b01-403f-a13b-b1ce22664ed8 req-25357dd9-f4d7-4613-92af-ae3975b7278d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3051ffe-ff68-4737-9838-12cb61b509a8", "name": "network-vif-plugged", "status": "completed", "tag": "da76e069-6a47-4f2c-b606-30c8b95c40c7"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:35:32.864185 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-a776173c-2b01-403f-a13b-b1ce22664ed8 req-25357dd9-f4d7-4613-92af-ae3975b7278d service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:32.864630 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-a776173c-2b01-403f-a13b-b1ce22664ed8 req-25357dd9-f4d7-4613-92af-ae3975b7278d service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:32.881125 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-a776173c-2b01-403f-a13b-b1ce22664ed8 req-25357dd9-f4d7-4613-92af-ae3975b7278d service nova] Creating event network-vif-plugged:da76e069-6a47-4f2c-b606-30c8b95c40c7 for instance a3051ffe-ff68-4737-9838-12cb61b509a8 on hv-cinder-84614 Jun 16 12:35:32.886738 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-a776173c-2b01-403f-a13b-b1ce22664ed8 req-25357dd9-f4d7-4613-92af-ae3975b7278d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035009 Jun 16 12:35:32.887334 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 450/910] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:35:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:35:33.473105 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e10afe26-0ee9-4a2e-95a5-f05760a578a4 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:35:33.473709 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e10afe26-0ee9-4a2e-95a5-f05760a578a4 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: a3051ffe-ff68-4737-9838-12cb61b509a8] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:33.480622 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e10afe26-0ee9-4a2e-95a5-f05760a578a4 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:33.481063 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e10afe26-0ee9-4a2e-95a5-f05760a578a4 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:33.481813 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e10afe26-0ee9-4a2e-95a5-f05760a578a4 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:33.482285 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e10afe26-0ee9-4a2e-95a5-f05760a578a4 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:33.489276 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d52be6c6-a12a-4539-92e1-fc44fe2abdf6 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:35:33.489993 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d52be6c6-a12a-4539-92e1-fc44fe2abdf6 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:33.496782 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d52be6c6-a12a-4539-92e1-fc44fe2abdf6 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:33.497228 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d52be6c6-a12a-4539-92e1-fc44fe2abdf6 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:33.498025 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d52be6c6-a12a-4539-92e1-fc44fe2abdf6 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:33.498462 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d52be6c6-a12a-4539-92e1-fc44fe2abdf6 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:33.684043 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e10afe26-0ee9-4a2e-95a5-f05760a578a4 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:33.687547 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d52be6c6-a12a-4539-92e1-fc44fe2abdf6 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:33.691789 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e10afe26-0ee9-4a2e-95a5-f05760a578a4 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/a3051ffe-ff68-4737-9838-12cb61b509a8" status: 200 len: 1365 microversion: 2.1 time: 0.222477 Jun 16 12:35:33.692363 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 461/911] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:35:33 2022] GET /compute/v2.1/servers/a3051ffe-ff68-4737-9838-12cb61b509a8 => generated 1365 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:35:33.695430 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d52be6c6-a12a-4539-92e1-fc44fe2abdf6 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:33.696996 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d52be6c6-a12a-4539-92e1-fc44fe2abdf6 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:33.698158 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d52be6c6-a12a-4539-92e1-fc44fe2abdf6 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 200 len: 1664 microversion: 2.20 time: 0.213531 Jun 16 12:35:33.698708 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 451/912] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:35:33 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 1664 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 12:35:33.715137 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-aa9fb80e-55e1-4b1f-9fd5-6eeaad0a468a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "10807910-14ed-494b-947c-1b6e6edf0d56"}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:35:33.716234 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-aa9fb80e-55e1-4b1f-9fd5-6eeaad0a468a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:33.722226 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-aa9fb80e-55e1-4b1f-9fd5-6eeaad0a468a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:33.722679 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-aa9fb80e-55e1-4b1f-9fd5-6eeaad0a468a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:33.723485 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-aa9fb80e-55e1-4b1f-9fd5-6eeaad0a468a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:33.723877 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-aa9fb80e-55e1-4b1f-9fd5-6eeaad0a468a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:34.131984 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-aa9fb80e-55e1-4b1f-9fd5-6eeaad0a468a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "POST /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.420716 Jun 16 12:35:34.132589 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 462/913] 10.222.0.45 () {62 vars in 1363 bytes} [Thu Jun 16 12:35:33 2022] POST /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e/os-volume_attachments => generated 188 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 12:35:34.256524 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-29193a6f-8457-4662-8e58-e32b92e65059 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:35:34.257017 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-29193a6f-8457-4662-8e58-e32b92e65059 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:34.263649 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-29193a6f-8457-4662-8e58-e32b92e65059 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:34.264100 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-29193a6f-8457-4662-8e58-e32b92e65059 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:34.264856 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-29193a6f-8457-4662-8e58-e32b92e65059 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:34.265290 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-29193a6f-8457-4662-8e58-e32b92e65059 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:34.509992 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-29193a6f-8457-4662-8e58-e32b92e65059 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "DELETE /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e/os-volume_attachments/10807910-14ed-494b-947c-1b6e6edf0d56" status: 202 len: 0 microversion: 2.20 time: 0.257292 Jun 16 12:35:34.513596 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 452/914] 10.222.0.45 () {60 vars in 1456 bytes} [Thu Jun 16 12:35:34 2022] DELETE /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e/os-volume_attachments/10807910-14ed-494b-947c-1b6e6edf0d56 => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 12:35:34.566223 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d1da4181-b02c-4fdf-b25c-8a3a1cadef6f tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:35:34.566796 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d1da4181-b02c-4fdf-b25c-8a3a1cadef6f tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:34.573926 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d1da4181-b02c-4fdf-b25c-8a3a1cadef6f tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:34.574367 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d1da4181-b02c-4fdf-b25c-8a3a1cadef6f tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:34.575118 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d1da4181-b02c-4fdf-b25c-8a3a1cadef6f tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:34.575550 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d1da4181-b02c-4fdf-b25c-8a3a1cadef6f tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:34.620824 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:35:34.667297 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d1da4181-b02c-4fdf-b25c-8a3a1cadef6f tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "POST /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e/action" status: 202 len: 0 microversion: 2.20 time: 0.105355 Jun 16 12:35:34.667923 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 463/915] 10.222.0.45 () {62 vars in 1318 bytes} [Thu Jun 16 12:35:34 2022] POST /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 12:35:34.676210 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-73e294d5-aa2d-46de-af0c-40990873fd68 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:35:34.676915 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-73e294d5-aa2d-46de-af0c-40990873fd68 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:34.684129 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-73e294d5-aa2d-46de-af0c-40990873fd68 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:34.684677 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-73e294d5-aa2d-46de-af0c-40990873fd68 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:34.685661 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-73e294d5-aa2d-46de-af0c-40990873fd68 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:34.686138 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-73e294d5-aa2d-46de-af0c-40990873fd68 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:34.710349 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c875b304-e4a0-45ab-90bd-c175d4d24baf tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:35:34.711175 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c875b304-e4a0-45ab-90bd-c175d4d24baf tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: a3051ffe-ff68-4737-9838-12cb61b509a8] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:34.718306 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c875b304-e4a0-45ab-90bd-c175d4d24baf tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:34.719125 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c875b304-e4a0-45ab-90bd-c175d4d24baf tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:34.719621 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c875b304-e4a0-45ab-90bd-c175d4d24baf tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:34.720021 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c875b304-e4a0-45ab-90bd-c175d4d24baf tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:34.891811 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-73e294d5-aa2d-46de-af0c-40990873fd68 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:34.900379 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-73e294d5-aa2d-46de-af0c-40990873fd68 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:34.901616 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-73e294d5-aa2d-46de-af0c-40990873fd68 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:34.902868 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-73e294d5-aa2d-46de-af0c-40990873fd68 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 200 len: 1672 microversion: 2.20 time: 0.230609 Jun 16 12:35:34.912574 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 453/916] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:35:34 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 1672 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:35:34.920750 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c875b304-e4a0-45ab-90bd-c175d4d24baf tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:34.934748 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c875b304-e4a0-45ab-90bd-c175d4d24baf tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/a3051ffe-ff68-4737-9838-12cb61b509a8" status: 200 len: 1365 microversion: 2.1 time: 0.228782 Jun 16 12:35:34.935665 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 464/917] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:35:34 2022] GET /compute/v2.1/servers/a3051ffe-ff68-4737-9838-12cb61b509a8 => generated 1365 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:35:34.949433 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-a22255c6-b3ac-4207-a454-268a9a1bf9ab req-cddbca29-8650-4d0e-ada1-ca4e903cf7b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f50c08e9-d310-424a-972c-1c16733a796e", "name": "network-vif-unplugged", "status": "completed", "tag": "54891bff-8bc6-48af-8125-5099eafe66f7"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:35:34.958215 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-a22255c6-b3ac-4207-a454-268a9a1bf9ab req-cddbca29-8650-4d0e-ada1-ca4e903cf7b8 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:34.958913 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-a22255c6-b3ac-4207-a454-268a9a1bf9ab req-cddbca29-8650-4d0e-ada1-ca4e903cf7b8 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:34.972964 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.compute.server_external_events [req-a22255c6-b3ac-4207-a454-268a9a1bf9ab req-cddbca29-8650-4d0e-ada1-ca4e903cf7b8 service nova] Unable to find a host for instance f50c08e9-d310-424a-972c-1c16733a796e. Dropping event network-vif-unplugged {{(pid=117606) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 16 12:35:34.973887 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-a22255c6-b3ac-4207-a454-268a9a1bf9ab req-cddbca29-8650-4d0e-ada1-ca4e903cf7b8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028923 Jun 16 12:35:34.975012 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 454/918] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:35:34 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 16 12:35:35.923218 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c32c10df-4bec-4bd5-964c-1516d75485ad tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:35:35.923818 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c32c10df-4bec-4bd5-964c-1516d75485ad tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:35.930292 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c32c10df-4bec-4bd5-964c-1516d75485ad tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:35.930684 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c32c10df-4bec-4bd5-964c-1516d75485ad tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:35.931641 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c32c10df-4bec-4bd5-964c-1516d75485ad tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:35.932084 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c32c10df-4bec-4bd5-964c-1516d75485ad tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:35.951643 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-cfa958f1-afa8-4c3f-8f11-2018da022436 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:35:35.952290 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-cfa958f1-afa8-4c3f-8f11-2018da022436 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: a3051ffe-ff68-4737-9838-12cb61b509a8] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:35.958809 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cfa958f1-afa8-4c3f-8f11-2018da022436 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:35.959256 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cfa958f1-afa8-4c3f-8f11-2018da022436 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:35.960018 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cfa958f1-afa8-4c3f-8f11-2018da022436 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:35.960455 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cfa958f1-afa8-4c3f-8f11-2018da022436 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:36.160611 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c32c10df-4bec-4bd5-964c-1516d75485ad tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:36.168691 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c32c10df-4bec-4bd5-964c-1516d75485ad tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:36.170213 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c32c10df-4bec-4bd5-964c-1516d75485ad tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:36.171359 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c32c10df-4bec-4bd5-964c-1516d75485ad tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 200 len: 1730 microversion: 2.20 time: 0.252044 Jun 16 12:35:36.171919 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 465/919] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:35:35 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 1730 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:35:36.172223 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-cfa958f1-afa8-4c3f-8f11-2018da022436 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:36.174592 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:35:36.182204 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-cfa958f1-afa8-4c3f-8f11-2018da022436 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/a3051ffe-ff68-4737-9838-12cb61b509a8" status: 200 len: 1555 microversion: 2.1 time: 0.234120 Jun 16 12:35:36.183252 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 455/920] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:35:35 2022] GET /compute/v2.1/servers/a3051ffe-ff68-4737-9838-12cb61b509a8 => generated 1555 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:35:36.199335 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f336f87f-769d-4559-9266-11c21b3d8c72 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:35:36.199831 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f336f87f-769d-4559-9266-11c21b3d8c72 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: a3051ffe-ff68-4737-9838-12cb61b509a8] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:36.206083 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f336f87f-769d-4559-9266-11c21b3d8c72 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:36.206536 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f336f87f-769d-4559-9266-11c21b3d8c72 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:36.207302 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f336f87f-769d-4559-9266-11c21b3d8c72 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:36.207736 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f336f87f-769d-4559-9266-11c21b3d8c72 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:36.554693 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f336f87f-769d-4559-9266-11c21b3d8c72 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/a3051ffe-ff68-4737-9838-12cb61b509a8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.360178 Jun 16 12:35:36.555382 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 466/921] 10.222.0.45 () {58 vars in 1274 bytes} [Thu Jun 16 12:35:36 2022] GET /compute/v2.1/servers/a3051ffe-ff68-4737-9838-12cb61b509a8/os-interface => generated 284 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:35:37.193491 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e75c6aa0-ecf3-47cd-aab9-ad7021b32fdf tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:35:37.194177 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e75c6aa0-ecf3-47cd-aab9-ad7021b32fdf tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:37.200583 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e75c6aa0-ecf3-47cd-aab9-ad7021b32fdf tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:37.201043 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e75c6aa0-ecf3-47cd-aab9-ad7021b32fdf tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:37.201821 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e75c6aa0-ecf3-47cd-aab9-ad7021b32fdf tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:37.202286 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e75c6aa0-ecf3-47cd-aab9-ad7021b32fdf tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:37.519779 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e75c6aa0-ecf3-47cd-aab9-ad7021b32fdf tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:37.533608 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e75c6aa0-ecf3-47cd-aab9-ad7021b32fdf tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:37.536894 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e75c6aa0-ecf3-47cd-aab9-ad7021b32fdf tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:37.539083 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e75c6aa0-ecf3-47cd-aab9-ad7021b32fdf tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 200 len: 1730 microversion: 2.20 time: 0.350749 Jun 16 12:35:37.551947 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 456/922] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:35:37 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 1730 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:35:37.848009 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-6a95b1f3-d1cb-4436-b295-2e117740b4b5 req-ba30b5c7-fadb-47fc-90de-c67b6be17ac1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3051ffe-ff68-4737-9838-12cb61b509a8", "tag": "da76e069-6a47-4f2c-b606-30c8b95c40c7"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:35:37.859562 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-6a95b1f3-d1cb-4436-b295-2e117740b4b5 req-ba30b5c7-fadb-47fc-90de-c67b6be17ac1 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:37.860800 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-6a95b1f3-d1cb-4436-b295-2e117740b4b5 req-ba30b5c7-fadb-47fc-90de-c67b6be17ac1 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:37.874524 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-6a95b1f3-d1cb-4436-b295-2e117740b4b5 req-ba30b5c7-fadb-47fc-90de-c67b6be17ac1 service nova] Creating event network-changed:da76e069-6a47-4f2c-b606-30c8b95c40c7 for instance a3051ffe-ff68-4737-9838-12cb61b509a8 on hv-cinder-84614 Jun 16 12:35:37.883603 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-6a95b1f3-d1cb-4436-b295-2e117740b4b5 req-ba30b5c7-fadb-47fc-90de-c67b6be17ac1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039769 Jun 16 12:35:37.885076 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 467/923] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:35:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:35:38.558801 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-bfb01689-5032-47fd-8270-954dc8e124d5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:35:38.559407 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-bfb01689-5032-47fd-8270-954dc8e124d5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:38.565774 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bfb01689-5032-47fd-8270-954dc8e124d5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:38.566251 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bfb01689-5032-47fd-8270-954dc8e124d5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:38.567003 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bfb01689-5032-47fd-8270-954dc8e124d5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:38.567437 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bfb01689-5032-47fd-8270-954dc8e124d5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:38.717741 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-bfb01689-5032-47fd-8270-954dc8e124d5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:38.726326 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-bfb01689-5032-47fd-8270-954dc8e124d5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:38.728544 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-bfb01689-5032-47fd-8270-954dc8e124d5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:38.739997 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-bfb01689-5032-47fd-8270-954dc8e124d5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 200 len: 1730 microversion: 2.20 time: 0.185525 Jun 16 12:35:38.741185 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 457/924] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:35:38 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 1730 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:35:39.759399 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3abd40a0-eae7-4e09-9936-d2438830677a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:35:39.760128 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3abd40a0-eae7-4e09-9936-d2438830677a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:39.766326 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3abd40a0-eae7-4e09-9936-d2438830677a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:39.766773 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3abd40a0-eae7-4e09-9936-d2438830677a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:39.767530 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3abd40a0-eae7-4e09-9936-d2438830677a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:39.767965 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3abd40a0-eae7-4e09-9936-d2438830677a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:39.897353 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-3abd40a0-eae7-4e09-9936-d2438830677a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:39.906336 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-3abd40a0-eae7-4e09-9936-d2438830677a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:39.907839 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-3abd40a0-eae7-4e09-9936-d2438830677a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:39.908990 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3abd40a0-eae7-4e09-9936-d2438830677a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 200 len: 1730 microversion: 2.20 time: 0.154489 Jun 16 12:35:39.909541 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 468/925] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:35:39 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:35:40.928505 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d39c32ce-2b25-4b82-a162-6ef497582cc4 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:35:40.929149 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d39c32ce-2b25-4b82-a162-6ef497582cc4 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:40.936332 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d39c32ce-2b25-4b82-a162-6ef497582cc4 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:40.936780 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d39c32ce-2b25-4b82-a162-6ef497582cc4 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:40.937545 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d39c32ce-2b25-4b82-a162-6ef497582cc4 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:40.938012 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d39c32ce-2b25-4b82-a162-6ef497582cc4 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:41.069984 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d39c32ce-2b25-4b82-a162-6ef497582cc4 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:41.077995 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d39c32ce-2b25-4b82-a162-6ef497582cc4 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:41.079492 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d39c32ce-2b25-4b82-a162-6ef497582cc4 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:41.080634 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d39c32ce-2b25-4b82-a162-6ef497582cc4 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 200 len: 1730 microversion: 2.20 time: 0.156026 Jun 16 12:35:41.081183 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 458/926] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:35:40 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:35:42.099127 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5c315258-caec-4241-8a12-24732a2fc458 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:35:42.099719 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5c315258-caec-4241-8a12-24732a2fc458 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:42.106306 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5c315258-caec-4241-8a12-24732a2fc458 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:42.106750 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5c315258-caec-4241-8a12-24732a2fc458 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:42.107509 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5c315258-caec-4241-8a12-24732a2fc458 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:42.107938 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5c315258-caec-4241-8a12-24732a2fc458 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:42.262805 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5c315258-caec-4241-8a12-24732a2fc458 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:42.271395 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5c315258-caec-4241-8a12-24732a2fc458 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:42.273272 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5c315258-caec-4241-8a12-24732a2fc458 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:42.275379 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5c315258-caec-4241-8a12-24732a2fc458 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 200 len: 1730 microversion: 2.20 time: 0.180224 Jun 16 12:35:42.286413 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 469/927] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:35:42 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 1730 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:35:43.296739 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f2902ce5-c70e-4044-8705-2ee97096a22f tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:35:43.297397 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f2902ce5-c70e-4044-8705-2ee97096a22f tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:43.304032 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f2902ce5-c70e-4044-8705-2ee97096a22f tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:43.304486 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f2902ce5-c70e-4044-8705-2ee97096a22f tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:43.305315 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f2902ce5-c70e-4044-8705-2ee97096a22f tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:43.305757 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f2902ce5-c70e-4044-8705-2ee97096a22f tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:43.449609 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f2902ce5-c70e-4044-8705-2ee97096a22f tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:43.458802 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f2902ce5-c70e-4044-8705-2ee97096a22f tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:43.460301 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f2902ce5-c70e-4044-8705-2ee97096a22f tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:43.461534 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f2902ce5-c70e-4044-8705-2ee97096a22f tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 200 len: 1730 microversion: 2.20 time: 0.168661 Jun 16 12:35:43.472864 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 459/928] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:35:43 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 1730 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:35:44.480041 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b921f993-a9dc-4336-bcdd-3f2343a8940d tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:35:44.480448 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b921f993-a9dc-4336-bcdd-3f2343a8940d tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:44.487083 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b921f993-a9dc-4336-bcdd-3f2343a8940d tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:44.487533 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b921f993-a9dc-4336-bcdd-3f2343a8940d tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:44.488292 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b921f993-a9dc-4336-bcdd-3f2343a8940d tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:44.488727 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b921f993-a9dc-4336-bcdd-3f2343a8940d tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:44.624518 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b921f993-a9dc-4336-bcdd-3f2343a8940d tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:44.632383 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b921f993-a9dc-4336-bcdd-3f2343a8940d tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:44.633952 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b921f993-a9dc-4336-bcdd-3f2343a8940d tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:44.635103 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b921f993-a9dc-4336-bcdd-3f2343a8940d tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 200 len: 1730 microversion: 2.20 time: 0.159854 Jun 16 12:35:44.635653 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 470/929] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:35:44 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:35:45.652685 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-04f73ed8-ecb7-4372-8e9a-ec8bb79e9be3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:35:45.653580 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-04f73ed8-ecb7-4372-8e9a-ec8bb79e9be3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:45.660334 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-04f73ed8-ecb7-4372-8e9a-ec8bb79e9be3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:45.660782 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-04f73ed8-ecb7-4372-8e9a-ec8bb79e9be3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:45.661543 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-04f73ed8-ecb7-4372-8e9a-ec8bb79e9be3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:45.662017 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-04f73ed8-ecb7-4372-8e9a-ec8bb79e9be3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:45.791256 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-04f73ed8-ecb7-4372-8e9a-ec8bb79e9be3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:45.799172 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-04f73ed8-ecb7-4372-8e9a-ec8bb79e9be3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:45.800672 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-04f73ed8-ecb7-4372-8e9a-ec8bb79e9be3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:45.801825 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-04f73ed8-ecb7-4372-8e9a-ec8bb79e9be3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 200 len: 1730 microversion: 2.20 time: 0.153205 Jun 16 12:35:45.802399 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 460/930] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:35:45 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:35:46.821467 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f86a5268-886a-471d-8247-ceef51da007a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:35:46.822257 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f86a5268-886a-471d-8247-ceef51da007a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:46.828757 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f86a5268-886a-471d-8247-ceef51da007a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:46.829202 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f86a5268-886a-471d-8247-ceef51da007a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:46.829992 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f86a5268-886a-471d-8247-ceef51da007a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:46.830430 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f86a5268-886a-471d-8247-ceef51da007a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:46.961704 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f86a5268-886a-471d-8247-ceef51da007a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:46.969601 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f86a5268-886a-471d-8247-ceef51da007a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:46.971144 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f86a5268-886a-471d-8247-ceef51da007a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:46.972296 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f86a5268-886a-471d-8247-ceef51da007a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 200 len: 1730 microversion: 2.20 time: 0.155742 Jun 16 12:35:46.972856 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 471/931] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:35:46 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:35:47.991346 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-de96d751-e186-4515-b39a-07cf473be85c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:35:47.991966 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-de96d751-e186-4515-b39a-07cf473be85c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:47.998645 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-de96d751-e186-4515-b39a-07cf473be85c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:47.999092 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-de96d751-e186-4515-b39a-07cf473be85c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:47.999852 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-de96d751-e186-4515-b39a-07cf473be85c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:48.000288 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-de96d751-e186-4515-b39a-07cf473be85c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:48.128662 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-de96d751-e186-4515-b39a-07cf473be85c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:48.137233 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-de96d751-e186-4515-b39a-07cf473be85c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:48.138755 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-de96d751-e186-4515-b39a-07cf473be85c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:48.139916 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-de96d751-e186-4515-b39a-07cf473be85c tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 200 len: 1730 microversion: 2.20 time: 0.152472 Jun 16 12:35:48.140475 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 461/932] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:35:47 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:35:49.159764 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a95896a1-36b5-445c-9c0b-fa2025f33267 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:35:49.161380 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a95896a1-36b5-445c-9c0b-fa2025f33267 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:49.170114 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a95896a1-36b5-445c-9c0b-fa2025f33267 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:49.170845 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a95896a1-36b5-445c-9c0b-fa2025f33267 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:49.171743 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a95896a1-36b5-445c-9c0b-fa2025f33267 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:49.172189 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a95896a1-36b5-445c-9c0b-fa2025f33267 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:49.310422 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a95896a1-36b5-445c-9c0b-fa2025f33267 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:49.318254 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a95896a1-36b5-445c-9c0b-fa2025f33267 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:49.319774 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a95896a1-36b5-445c-9c0b-fa2025f33267 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:49.321582 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a95896a1-36b5-445c-9c0b-fa2025f33267 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 200 len: 1730 microversion: 2.20 time: 0.166666 Jun 16 12:35:49.322184 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 472/933] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:35:49 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 12:35:50.340264 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f430e1f9-79c8-4ac8-8f0d-d540de19bfae tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:35:50.340899 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f430e1f9-79c8-4ac8-8f0d-d540de19bfae tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:50.347294 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f430e1f9-79c8-4ac8-8f0d-d540de19bfae tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:50.347742 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f430e1f9-79c8-4ac8-8f0d-d540de19bfae tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:50.348491 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f430e1f9-79c8-4ac8-8f0d-d540de19bfae tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:50.348950 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f430e1f9-79c8-4ac8-8f0d-d540de19bfae tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:50.486392 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f430e1f9-79c8-4ac8-8f0d-d540de19bfae tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:50.496198 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f430e1f9-79c8-4ac8-8f0d-d540de19bfae tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:50.498317 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f430e1f9-79c8-4ac8-8f0d-d540de19bfae tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:50.499784 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f430e1f9-79c8-4ac8-8f0d-d540de19bfae tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 200 len: 1730 microversion: 2.20 time: 0.164070 Jun 16 12:35:50.512428 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 462/934] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:35:50 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:35:51.519237 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ab52d8c9-8c06-4fc8-bd4b-4946f61c8510 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:35:51.519856 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ab52d8c9-8c06-4fc8-bd4b-4946f61c8510 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:51.528360 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ab52d8c9-8c06-4fc8-bd4b-4946f61c8510 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:51.528820 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ab52d8c9-8c06-4fc8-bd4b-4946f61c8510 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:51.529837 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ab52d8c9-8c06-4fc8-bd4b-4946f61c8510 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:51.530359 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ab52d8c9-8c06-4fc8-bd4b-4946f61c8510 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:51.665473 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ab52d8c9-8c06-4fc8-bd4b-4946f61c8510 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:51.673436 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ab52d8c9-8c06-4fc8-bd4b-4946f61c8510 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:51.675116 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ab52d8c9-8c06-4fc8-bd4b-4946f61c8510 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:51.676253 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ab52d8c9-8c06-4fc8-bd4b-4946f61c8510 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 200 len: 1730 microversion: 2.20 time: 0.161138 Jun 16 12:35:51.676803 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 473/935] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:35:51 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:35:52.694738 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b474f996-8ccc-4841-96d7-45acaca03bd1 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:35:52.696040 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b474f996-8ccc-4841-96d7-45acaca03bd1 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:52.702318 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b474f996-8ccc-4841-96d7-45acaca03bd1 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:52.702764 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b474f996-8ccc-4841-96d7-45acaca03bd1 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:52.703523 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b474f996-8ccc-4841-96d7-45acaca03bd1 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:52.703955 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b474f996-8ccc-4841-96d7-45acaca03bd1 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:52.836925 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b474f996-8ccc-4841-96d7-45acaca03bd1 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:52.845203 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b474f996-8ccc-4841-96d7-45acaca03bd1 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:52.846726 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b474f996-8ccc-4841-96d7-45acaca03bd1 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:52.847874 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b474f996-8ccc-4841-96d7-45acaca03bd1 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 200 len: 1730 microversion: 2.20 time: 0.156995 Jun 16 12:35:52.848427 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 463/936] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:35:52 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:35:53.865854 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d1c81e9d-eda5-4378-ba60-26307090ee25 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:35:53.866484 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d1c81e9d-eda5-4378-ba60-26307090ee25 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:53.873526 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d1c81e9d-eda5-4378-ba60-26307090ee25 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:53.874013 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d1c81e9d-eda5-4378-ba60-26307090ee25 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:53.874777 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d1c81e9d-eda5-4378-ba60-26307090ee25 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:53.875214 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d1c81e9d-eda5-4378-ba60-26307090ee25 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:54.003407 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d1c81e9d-eda5-4378-ba60-26307090ee25 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:54.011853 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d1c81e9d-eda5-4378-ba60-26307090ee25 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:54.013572 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d1c81e9d-eda5-4378-ba60-26307090ee25 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:54.014765 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d1c81e9d-eda5-4378-ba60-26307090ee25 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 200 len: 1730 microversion: 2.20 time: 0.152819 Jun 16 12:35:54.015326 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 474/937] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:35:53 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:35:55.032913 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2eee0efe-4528-4cfc-bfe8-a5b2569f6157 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:35:55.033507 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2eee0efe-4528-4cfc-bfe8-a5b2569f6157 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:55.040425 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2eee0efe-4528-4cfc-bfe8-a5b2569f6157 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:55.040874 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2eee0efe-4528-4cfc-bfe8-a5b2569f6157 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:55.041645 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2eee0efe-4528-4cfc-bfe8-a5b2569f6157 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:55.042111 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2eee0efe-4528-4cfc-bfe8-a5b2569f6157 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:55.185045 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2eee0efe-4528-4cfc-bfe8-a5b2569f6157 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:55.192957 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2eee0efe-4528-4cfc-bfe8-a5b2569f6157 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:55.194497 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2eee0efe-4528-4cfc-bfe8-a5b2569f6157 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:55.196232 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2eee0efe-4528-4cfc-bfe8-a5b2569f6157 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 200 len: 1730 microversion: 2.20 time: 0.167216 Jun 16 12:35:55.196784 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 464/938] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:35:55 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:35:56.213816 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d9273cd3-b795-4399-ba17-52b93b28a43a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:35:56.214454 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d9273cd3-b795-4399-ba17-52b93b28a43a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:56.221145 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d9273cd3-b795-4399-ba17-52b93b28a43a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:56.221603 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d9273cd3-b795-4399-ba17-52b93b28a43a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:56.222407 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d9273cd3-b795-4399-ba17-52b93b28a43a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:56.222848 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d9273cd3-b795-4399-ba17-52b93b28a43a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:56.356533 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d9273cd3-b795-4399-ba17-52b93b28a43a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:56.364611 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d9273cd3-b795-4399-ba17-52b93b28a43a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:56.366172 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d9273cd3-b795-4399-ba17-52b93b28a43a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:56.367922 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d9273cd3-b795-4399-ba17-52b93b28a43a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 200 len: 1730 microversion: 2.20 time: 0.157506 Jun 16 12:35:56.368487 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 475/939] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:35:56 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:35:57.386043 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4d4a1b02-65b7-4132-8fa2-ebaf94c5671b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:35:57.387291 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4d4a1b02-65b7-4132-8fa2-ebaf94c5671b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:57.393470 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4d4a1b02-65b7-4132-8fa2-ebaf94c5671b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:57.393944 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4d4a1b02-65b7-4132-8fa2-ebaf94c5671b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:57.394756 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4d4a1b02-65b7-4132-8fa2-ebaf94c5671b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:57.395185 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4d4a1b02-65b7-4132-8fa2-ebaf94c5671b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:57.525816 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4d4a1b02-65b7-4132-8fa2-ebaf94c5671b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:57.533970 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4d4a1b02-65b7-4132-8fa2-ebaf94c5671b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:57.535481 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4d4a1b02-65b7-4132-8fa2-ebaf94c5671b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:57.536630 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4d4a1b02-65b7-4132-8fa2-ebaf94c5671b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 200 len: 1730 microversion: 2.20 time: 0.154544 Jun 16 12:35:57.537195 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 465/940] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:35:57 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:35:58.555325 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-47920d4f-a963-458d-9f68-5c852ff181c7 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:35:58.555945 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-47920d4f-a963-458d-9f68-5c852ff181c7 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:58.562952 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-47920d4f-a963-458d-9f68-5c852ff181c7 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:58.563499 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-47920d4f-a963-458d-9f68-5c852ff181c7 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:58.564407 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-47920d4f-a963-458d-9f68-5c852ff181c7 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:58.564902 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-47920d4f-a963-458d-9f68-5c852ff181c7 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:58.696718 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-47920d4f-a963-458d-9f68-5c852ff181c7 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:58.704638 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-47920d4f-a963-458d-9f68-5c852ff181c7 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:58.706222 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-47920d4f-a963-458d-9f68-5c852ff181c7 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:58.707406 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-47920d4f-a963-458d-9f68-5c852ff181c7 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 200 len: 1730 microversion: 2.20 time: 0.156084 Jun 16 12:35:58.707970 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 476/941] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:35:58 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:35:59.724494 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-65047623-ba68-4f30-8530-e858de472c40 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:35:59.725155 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-65047623-ba68-4f30-8530-e858de472c40 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:35:59.732491 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-65047623-ba68-4f30-8530-e858de472c40 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:59.732942 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-65047623-ba68-4f30-8530-e858de472c40 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:59.733710 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-65047623-ba68-4f30-8530-e858de472c40 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:35:59.734205 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-65047623-ba68-4f30-8530-e858de472c40 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:35:59.868062 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-65047623-ba68-4f30-8530-e858de472c40 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:59.876045 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-65047623-ba68-4f30-8530-e858de472c40 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:59.877612 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-65047623-ba68-4f30-8530-e858de472c40 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:35:59.878788 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-65047623-ba68-4f30-8530-e858de472c40 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 200 len: 1730 microversion: 2.20 time: 0.158220 Jun 16 12:35:59.879346 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 466/942] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:35:59 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:36:00.899582 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-fdbb2973-d790-45f0-83e2-6b8744420a8f tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:36:00.900193 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-fdbb2973-d790-45f0-83e2-6b8744420a8f tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:36:00.902290 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=40 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:36:00.907548 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fdbb2973-d790-45f0-83e2-6b8744420a8f tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:00.908006 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fdbb2973-d790-45f0-83e2-6b8744420a8f tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:00.908784 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fdbb2973-d790-45f0-83e2-6b8744420a8f tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:00.909229 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fdbb2973-d790-45f0-83e2-6b8744420a8f tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:00.968431 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-4228d3ba-5326-4ffd-bc8f-5973ec2d56c8 req-41220d0e-1bc6-4c43-b178-297adbd1a3b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f50c08e9-d310-424a-972c-1c16733a796e", "name": "network-vif-plugged", "status": "completed", "tag": "54891bff-8bc6-48af-8125-5099eafe66f7"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:36:00.980340 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-4228d3ba-5326-4ffd-bc8f-5973ec2d56c8 req-41220d0e-1bc6-4c43-b178-297adbd1a3b4 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:00.981077 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-4228d3ba-5326-4ffd-bc8f-5973ec2d56c8 req-41220d0e-1bc6-4c43-b178-297adbd1a3b4 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:00.994144 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-4228d3ba-5326-4ffd-bc8f-5973ec2d56c8 req-41220d0e-1bc6-4c43-b178-297adbd1a3b4 service nova] Creating event network-vif-plugged:54891bff-8bc6-48af-8125-5099eafe66f7 for instance f50c08e9-d310-424a-972c-1c16733a796e on hv-cinder-84614 Jun 16 12:36:00.999445 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-4228d3ba-5326-4ffd-bc8f-5973ec2d56c8 req-41220d0e-1bc6-4c43-b178-297adbd1a3b4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034693 Jun 16 12:36:01.000390 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 467/943] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:36:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:36:01.043727 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-fdbb2973-d790-45f0-83e2-6b8744420a8f tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:36:01.051923 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-fdbb2973-d790-45f0-83e2-6b8744420a8f tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:36:01.053545 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-fdbb2973-d790-45f0-83e2-6b8744420a8f tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:36:01.055494 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-fdbb2973-d790-45f0-83e2-6b8744420a8f tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 200 len: 1730 microversion: 2.20 time: 0.162677 Jun 16 12:36:01.056206 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 477/944] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:36:00 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:36:02.075459 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c6673832-aa9e-4686-ae42-469a4d78a04a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:36:02.076146 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c6673832-aa9e-4686-ae42-469a4d78a04a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:36:02.082802 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c6673832-aa9e-4686-ae42-469a4d78a04a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:02.083246 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c6673832-aa9e-4686-ae42-469a4d78a04a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:02.083999 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c6673832-aa9e-4686-ae42-469a4d78a04a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:02.084431 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c6673832-aa9e-4686-ae42-469a4d78a04a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:02.215035 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c6673832-aa9e-4686-ae42-469a4d78a04a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:36:02.223088 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c6673832-aa9e-4686-ae42-469a4d78a04a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:36:02.224604 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c6673832-aa9e-4686-ae42-469a4d78a04a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:36:02.225775 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c6673832-aa9e-4686-ae42-469a4d78a04a tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 200 len: 1730 microversion: 2.20 time: 0.155581 Jun 16 12:36:02.226367 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 468/945] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:36:02 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:36:03.244503 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-91eac18b-27aa-4c7f-a6b9-a6c1a70ee8a5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:36:03.245111 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-91eac18b-27aa-4c7f-a6b9-a6c1a70ee8a5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:36:03.254104 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-91eac18b-27aa-4c7f-a6b9-a6c1a70ee8a5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:03.254561 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-91eac18b-27aa-4c7f-a6b9-a6c1a70ee8a5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:03.255332 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-91eac18b-27aa-4c7f-a6b9-a6c1a70ee8a5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:03.255780 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-91eac18b-27aa-4c7f-a6b9-a6c1a70ee8a5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:03.393858 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-91eac18b-27aa-4c7f-a6b9-a6c1a70ee8a5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:36:03.402254 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-91eac18b-27aa-4c7f-a6b9-a6c1a70ee8a5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:36:03.404028 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-91eac18b-27aa-4c7f-a6b9-a6c1a70ee8a5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:36:03.405182 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-91eac18b-27aa-4c7f-a6b9-a6c1a70ee8a5 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 200 len: 1730 microversion: 2.20 time: 0.164759 Jun 16 12:36:03.405740 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 478/946] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:36:03 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:36:04.379160 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-caa0b017-3760-4940-b904-90f614c8e913 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:36:04.379638 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-caa0b017-3760-4940-b904-90f614c8e913 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: 8e91b2d7-1250-4cca-965d-c18107d8c3a1] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:36:04.382102 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=40 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:36:04.387749 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-caa0b017-3760-4940-b904-90f614c8e913 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:04.388223 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-caa0b017-3760-4940-b904-90f614c8e913 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:04.388981 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-caa0b017-3760-4940-b904-90f614c8e913 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:04.389417 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-caa0b017-3760-4940-b904-90f614c8e913 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:04.415294 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-caa0b017-3760-4940-b904-90f614c8e913 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1/ips" status: 200 len: 145 microversion: 2.1 time: 0.039988 Jun 16 12:36:04.415853 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 469/947] 10.222.0.45 () {58 vars in 1247 bytes} [Thu Jun 16 12:36:04 2022] GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1/ips => generated 145 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:36:04.424081 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-9ef39e16-402c-4716-9ff9-35c6dcc5e410 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:36:04.424693 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-9ef39e16-402c-4716-9ff9-35c6dcc5e410 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:36:04.431912 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9ef39e16-402c-4716-9ff9-35c6dcc5e410 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:04.432352 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9ef39e16-402c-4716-9ff9-35c6dcc5e410 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:04.433111 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9ef39e16-402c-4716-9ff9-35c6dcc5e410 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:04.433543 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9ef39e16-402c-4716-9ff9-35c6dcc5e410 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:04.568053 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-9ef39e16-402c-4716-9ff9-35c6dcc5e410 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:36:04.576402 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-9ef39e16-402c-4716-9ff9-35c6dcc5e410 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:36:04.577926 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-9ef39e16-402c-4716-9ff9-35c6dcc5e410 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:36:04.579191 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-9ef39e16-402c-4716-9ff9-35c6dcc5e410 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 200 len: 1717 microversion: 2.20 time: 0.159204 Jun 16 12:36:04.579769 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 479/948] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:36:04 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 1717 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:36:05.706537 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4c1a75da-8af9-472a-abbd-78bf54518f71 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:36:05.707098 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4c1a75da-8af9-472a-abbd-78bf54518f71 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] [instance: 198edd63-e22e-42ca-8c37-89b4f87bab60] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:36:05.713948 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4c1a75da-8af9-472a-abbd-78bf54518f71 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:05.714402 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4c1a75da-8af9-472a-abbd-78bf54518f71 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:05.715164 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4c1a75da-8af9-472a-abbd-78bf54518f71 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:05.715599 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4c1a75da-8af9-472a-abbd-78bf54518f71 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:05.737260 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.objects.instance [None req-4c1a75da-8af9-472a-abbd-78bf54518f71 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lazy-loading 'flavor' on Instance uuid 198edd63-e22e-42ca-8c37-89b4f87bab60 {{(pid=117606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 12:36:05.810228 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4c1a75da-8af9-472a-abbd-78bf54518f71 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] 10.222.0.45 "POST /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60/action" status: 202 len: 0 microversion: 2.1 time: 0.107349 Jun 16 12:36:05.810812 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 470/949] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Jun 16 12:36:05 2022] POST /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 12:36:05.818927 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a9f3c0e6-d88a-4a6d-a091-977aeb4b4d0b tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:36:05.819552 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a9f3c0e6-d88a-4a6d-a091-977aeb4b4d0b tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] [instance: 198edd63-e22e-42ca-8c37-89b4f87bab60] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:36:05.825974 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a9f3c0e6-d88a-4a6d-a091-977aeb4b4d0b tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:05.826430 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a9f3c0e6-d88a-4a6d-a091-977aeb4b4d0b tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:05.827202 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a9f3c0e6-d88a-4a6d-a091-977aeb4b4d0b tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:05.827640 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a9f3c0e6-d88a-4a6d-a091-977aeb4b4d0b tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:05.832233 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:36:05.962542 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a9f3c0e6-d88a-4a6d-a091-977aeb4b4d0b tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f18557a45846c1bd9075f8a0717652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf2d3eca81148afa04159506decfdce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:36:05.969903 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a9f3c0e6-d88a-4a6d-a091-977aeb4b4d0b tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] 10.222.0.45 "GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60" status: 200 len: 1569 microversion: 2.1 time: 0.154872 Jun 16 12:36:05.970464 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 480/950] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:36:05 2022] GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:36:06.987817 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d8083fac-648d-4998-b2d3-431d6e5aff47 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:36:06.988506 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d8083fac-648d-4998-b2d3-431d6e5aff47 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] [instance: 198edd63-e22e-42ca-8c37-89b4f87bab60] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:36:06.995303 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d8083fac-648d-4998-b2d3-431d6e5aff47 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:06.995747 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d8083fac-648d-4998-b2d3-431d6e5aff47 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:06.996504 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d8083fac-648d-4998-b2d3-431d6e5aff47 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:06.996940 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d8083fac-648d-4998-b2d3-431d6e5aff47 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:07.011912 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:36:07.128255 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d8083fac-648d-4998-b2d3-431d6e5aff47 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f18557a45846c1bd9075f8a0717652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf2d3eca81148afa04159506decfdce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:36:07.135570 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d8083fac-648d-4998-b2d3-431d6e5aff47 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] 10.222.0.45 "GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60" status: 200 len: 1569 microversion: 2.1 time: 0.152340 Jun 16 12:36:07.136126 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 471/951] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:36:06 2022] GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:36:07.764138 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b83725f5-7d39-45ba-8cd7-3ac0ec1fbcf8 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "33e1c91e-3849-4d10-a484-334739e0efd4"}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:36:07.765272 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b83725f5-7d39-45ba-8cd7-3ac0ec1fbcf8 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: 8e91b2d7-1250-4cca-965d-c18107d8c3a1] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:36:07.771517 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b83725f5-7d39-45ba-8cd7-3ac0ec1fbcf8 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:07.771961 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b83725f5-7d39-45ba-8cd7-3ac0ec1fbcf8 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:07.772708 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b83725f5-7d39-45ba-8cd7-3ac0ec1fbcf8 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:07.774157 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b83725f5-7d39-45ba-8cd7-3ac0ec1fbcf8 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:08.029140 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b83725f5-7d39-45ba-8cd7-3ac0ec1fbcf8 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "POST /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.268654 Jun 16 12:36:08.029735 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 481/952] 10.222.0.45 () {60 vars in 1322 bytes} [Thu Jun 16 12:36:07 2022] POST /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1/os-volume_attachments => generated 194 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:36:08.153752 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-25bb39af-7bf6-4cac-a5fc-8bb93c2bb1d6 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:36:08.154428 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-25bb39af-7bf6-4cac-a5fc-8bb93c2bb1d6 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] [instance: 198edd63-e22e-42ca-8c37-89b4f87bab60] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:36:08.161155 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-25bb39af-7bf6-4cac-a5fc-8bb93c2bb1d6 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:08.161611 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-25bb39af-7bf6-4cac-a5fc-8bb93c2bb1d6 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:08.162477 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-25bb39af-7bf6-4cac-a5fc-8bb93c2bb1d6 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:08.162921 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-25bb39af-7bf6-4cac-a5fc-8bb93c2bb1d6 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:08.309382 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-25bb39af-7bf6-4cac-a5fc-8bb93c2bb1d6 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f18557a45846c1bd9075f8a0717652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf2d3eca81148afa04159506decfdce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:36:08.318132 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-25bb39af-7bf6-4cac-a5fc-8bb93c2bb1d6 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] 10.222.0.45 "GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60" status: 200 len: 1569 microversion: 2.1 time: 0.168425 Jun 16 12:36:08.318705 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 472/953] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:36:08 2022] GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60 => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:36:09.338913 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-73d443aa-d5af-49bd-950e-df849c66854a tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:36:09.339531 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-73d443aa-d5af-49bd-950e-df849c66854a tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] [instance: 198edd63-e22e-42ca-8c37-89b4f87bab60] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:36:09.346283 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-73d443aa-d5af-49bd-950e-df849c66854a tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:09.346730 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-73d443aa-d5af-49bd-950e-df849c66854a tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:09.347485 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-73d443aa-d5af-49bd-950e-df849c66854a tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:09.347917 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-73d443aa-d5af-49bd-950e-df849c66854a tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:09.478023 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-73d443aa-d5af-49bd-950e-df849c66854a tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f18557a45846c1bd9075f8a0717652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf2d3eca81148afa04159506decfdce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:36:09.485491 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-73d443aa-d5af-49bd-950e-df849c66854a tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] 10.222.0.45 "GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60" status: 200 len: 1569 microversion: 2.1 time: 0.151982 Jun 16 12:36:09.486095 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 482/954] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:36:09 2022] GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:36:10.501559 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c29cad69-d7be-4393-a805-94bfcdc7eab0 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:36:10.502191 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c29cad69-d7be-4393-a805-94bfcdc7eab0 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] [instance: 198edd63-e22e-42ca-8c37-89b4f87bab60] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:36:10.509149 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c29cad69-d7be-4393-a805-94bfcdc7eab0 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:10.509592 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c29cad69-d7be-4393-a805-94bfcdc7eab0 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:10.510381 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c29cad69-d7be-4393-a805-94bfcdc7eab0 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:10.510814 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c29cad69-d7be-4393-a805-94bfcdc7eab0 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:10.647027 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c29cad69-d7be-4393-a805-94bfcdc7eab0 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f18557a45846c1bd9075f8a0717652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf2d3eca81148afa04159506decfdce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:36:10.655331 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c29cad69-d7be-4393-a805-94bfcdc7eab0 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] 10.222.0.45 "GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60" status: 200 len: 1569 microversion: 2.1 time: 0.157659 Jun 16 12:36:10.655933 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 473/955] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:36:10 2022] GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:36:11.672494 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1a1eb7bb-6cc1-4605-a1a5-3424f5d2cbe1 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:36:11.673135 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1a1eb7bb-6cc1-4605-a1a5-3424f5d2cbe1 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] [instance: 198edd63-e22e-42ca-8c37-89b4f87bab60] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:36:11.679598 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1a1eb7bb-6cc1-4605-a1a5-3424f5d2cbe1 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:11.680620 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1a1eb7bb-6cc1-4605-a1a5-3424f5d2cbe1 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:11.681363 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1a1eb7bb-6cc1-4605-a1a5-3424f5d2cbe1 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:11.681794 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1a1eb7bb-6cc1-4605-a1a5-3424f5d2cbe1 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:11.810423 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1a1eb7bb-6cc1-4605-a1a5-3424f5d2cbe1 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f18557a45846c1bd9075f8a0717652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf2d3eca81148afa04159506decfdce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:36:11.817772 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1a1eb7bb-6cc1-4605-a1a5-3424f5d2cbe1 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] 10.222.0.45 "GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60" status: 200 len: 1569 microversion: 2.1 time: 0.149123 Jun 16 12:36:11.818353 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 483/956] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:36:11 2022] GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:36:12.834941 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-76153442-7d40-4085-b474-4079ddb7e994 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:36:12.835549 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-76153442-7d40-4085-b474-4079ddb7e994 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] [instance: 198edd63-e22e-42ca-8c37-89b4f87bab60] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:36:12.842031 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-76153442-7d40-4085-b474-4079ddb7e994 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:12.842527 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-76153442-7d40-4085-b474-4079ddb7e994 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:12.843223 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-76153442-7d40-4085-b474-4079ddb7e994 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:12.843657 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-76153442-7d40-4085-b474-4079ddb7e994 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:12.975944 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-76153442-7d40-4085-b474-4079ddb7e994 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f18557a45846c1bd9075f8a0717652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf2d3eca81148afa04159506decfdce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:36:12.984010 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-76153442-7d40-4085-b474-4079ddb7e994 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] 10.222.0.45 "GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60" status: 200 len: 1569 microversion: 2.1 time: 0.152959 Jun 16 12:36:12.984573 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 474/957] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:36:12 2022] GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:36:14.000848 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5d438cb9-1603-4252-a87c-f758e3a29a23 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:36:14.001522 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5d438cb9-1603-4252-a87c-f758e3a29a23 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] [instance: 198edd63-e22e-42ca-8c37-89b4f87bab60] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:36:14.008637 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5d438cb9-1603-4252-a87c-f758e3a29a23 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:14.009110 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5d438cb9-1603-4252-a87c-f758e3a29a23 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:14.009904 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5d438cb9-1603-4252-a87c-f758e3a29a23 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:14.010346 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5d438cb9-1603-4252-a87c-f758e3a29a23 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:14.138923 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5d438cb9-1603-4252-a87c-f758e3a29a23 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f18557a45846c1bd9075f8a0717652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf2d3eca81148afa04159506decfdce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:36:14.146359 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5d438cb9-1603-4252-a87c-f758e3a29a23 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] 10.222.0.45 "GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60" status: 200 len: 1569 microversion: 2.1 time: 0.149347 Jun 16 12:36:14.146927 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 484/958] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:36:13 2022] GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:36:15.163050 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5c8cf5bf-578f-494f-8459-c147f87ff0a6 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:36:15.163702 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5c8cf5bf-578f-494f-8459-c147f87ff0a6 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] [instance: 198edd63-e22e-42ca-8c37-89b4f87bab60] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:36:15.170216 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5c8cf5bf-578f-494f-8459-c147f87ff0a6 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:15.170668 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5c8cf5bf-578f-494f-8459-c147f87ff0a6 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:15.171431 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5c8cf5bf-578f-494f-8459-c147f87ff0a6 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:15.171869 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5c8cf5bf-578f-494f-8459-c147f87ff0a6 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:15.302810 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5c8cf5bf-578f-494f-8459-c147f87ff0a6 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f18557a45846c1bd9075f8a0717652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf2d3eca81148afa04159506decfdce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:36:15.310913 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5c8cf5bf-578f-494f-8459-c147f87ff0a6 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] 10.222.0.45 "GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60" status: 200 len: 1569 microversion: 2.1 time: 0.151687 Jun 16 12:36:15.311478 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 475/959] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:36:15 2022] GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:36:15.514432 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d01b313e-cc6b-4d90-adea-f5f4cd65a1f9 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:36:15.520888 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d01b313e-cc6b-4d90-adea-f5f4cd65a1f9 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:15.521342 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d01b313e-cc6b-4d90-adea-f5f4cd65a1f9 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:15.582868 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d01b313e-cc6b-4d90-adea-f5f4cd65a1f9 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: 8e91b2d7-1250-4cca-965d-c18107d8c3a1] Going to try to stop instance {{(pid=117607) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 16 12:36:15.628162 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d01b313e-cc6b-4d90-adea-f5f4cd65a1f9 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "POST /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1/action" status: 202 len: 0 microversion: 2.1 time: 0.117330 Jun 16 12:36:15.628748 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 485/960] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Jun 16 12:36:15 2022] POST /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 12:36:15.637309 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-dea6e3f8-eaf6-440b-bdf9-3b83da20e93a tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:36:15.638049 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-dea6e3f8-eaf6-440b-bdf9-3b83da20e93a tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: 8e91b2d7-1250-4cca-965d-c18107d8c3a1] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:36:15.643949 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dea6e3f8-eaf6-440b-bdf9-3b83da20e93a tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:15.644402 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dea6e3f8-eaf6-440b-bdf9-3b83da20e93a tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:15.645157 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dea6e3f8-eaf6-440b-bdf9-3b83da20e93a tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:15.645596 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dea6e3f8-eaf6-440b-bdf9-3b83da20e93a tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:15.779929 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-dea6e3f8-eaf6-440b-bdf9-3b83da20e93a tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e53fdd4ca2b4fd8b64caea6924fa969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb62ca3babf9402996e0ef47fc0d8e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:36:15.787821 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-dea6e3f8-eaf6-440b-bdf9-3b83da20e93a tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1" status: 200 len: 1722 microversion: 2.1 time: 0.154938 Jun 16 12:36:15.788380 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 476/961] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:36:15 2022] GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:36:16.328402 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b313a76e-b5a8-4d26-8ecb-2dc3e79b5964 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:36:16.329100 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b313a76e-b5a8-4d26-8ecb-2dc3e79b5964 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] [instance: 198edd63-e22e-42ca-8c37-89b4f87bab60] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:36:16.335591 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b313a76e-b5a8-4d26-8ecb-2dc3e79b5964 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:16.336815 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b313a76e-b5a8-4d26-8ecb-2dc3e79b5964 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:16.337583 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b313a76e-b5a8-4d26-8ecb-2dc3e79b5964 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:16.338050 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b313a76e-b5a8-4d26-8ecb-2dc3e79b5964 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:16.535810 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b313a76e-b5a8-4d26-8ecb-2dc3e79b5964 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f18557a45846c1bd9075f8a0717652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf2d3eca81148afa04159506decfdce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:36:16.543437 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b313a76e-b5a8-4d26-8ecb-2dc3e79b5964 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] 10.222.0.45 "GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60" status: 200 len: 1569 microversion: 2.1 time: 0.219282 Jun 16 12:36:16.544012 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 486/962] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:36:16 2022] GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60 => generated 1569 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:36:16.806896 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-48af5f24-a2e6-44d3-ae80-3d8ed05ac665 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:36:16.807533 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-48af5f24-a2e6-44d3-ae80-3d8ed05ac665 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: 8e91b2d7-1250-4cca-965d-c18107d8c3a1] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:36:16.814187 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-48af5f24-a2e6-44d3-ae80-3d8ed05ac665 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:16.814637 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-48af5f24-a2e6-44d3-ae80-3d8ed05ac665 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:16.815401 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-48af5f24-a2e6-44d3-ae80-3d8ed05ac665 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:16.815837 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-48af5f24-a2e6-44d3-ae80-3d8ed05ac665 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:16.944368 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-48af5f24-a2e6-44d3-ae80-3d8ed05ac665 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e53fdd4ca2b4fd8b64caea6924fa969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb62ca3babf9402996e0ef47fc0d8e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:36:16.952787 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-48af5f24-a2e6-44d3-ae80-3d8ed05ac665 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1" status: 200 len: 1722 microversion: 2.1 time: 0.150854 Jun 16 12:36:16.953351 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 477/963] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:36:16 2022] GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:36:17.559825 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0014e99c-0fd6-4527-abdf-51096eef82d7 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:36:17.560431 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0014e99c-0fd6-4527-abdf-51096eef82d7 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] [instance: 198edd63-e22e-42ca-8c37-89b4f87bab60] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:36:17.566871 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0014e99c-0fd6-4527-abdf-51096eef82d7 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:17.567323 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0014e99c-0fd6-4527-abdf-51096eef82d7 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:17.568082 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0014e99c-0fd6-4527-abdf-51096eef82d7 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:17.568518 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0014e99c-0fd6-4527-abdf-51096eef82d7 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:17.697661 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0014e99c-0fd6-4527-abdf-51096eef82d7 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f18557a45846c1bd9075f8a0717652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf2d3eca81148afa04159506decfdce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:36:17.705105 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0014e99c-0fd6-4527-abdf-51096eef82d7 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] 10.222.0.45 "GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60" status: 200 len: 1569 microversion: 2.1 time: 0.149067 Jun 16 12:36:17.705666 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 487/964] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:36:17 2022] GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:36:17.969745 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c588acfb-3544-4cc0-aeff-a4da23c80dbb tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:36:17.970389 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c588acfb-3544-4cc0-aeff-a4da23c80dbb tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: 8e91b2d7-1250-4cca-965d-c18107d8c3a1] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:36:17.976925 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c588acfb-3544-4cc0-aeff-a4da23c80dbb tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:17.977374 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c588acfb-3544-4cc0-aeff-a4da23c80dbb tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:17.978162 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c588acfb-3544-4cc0-aeff-a4da23c80dbb tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:17.978611 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c588acfb-3544-4cc0-aeff-a4da23c80dbb tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:18.107246 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c588acfb-3544-4cc0-aeff-a4da23c80dbb tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e53fdd4ca2b4fd8b64caea6924fa969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb62ca3babf9402996e0ef47fc0d8e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:36:18.115186 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c588acfb-3544-4cc0-aeff-a4da23c80dbb tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1" status: 200 len: 1722 microversion: 2.1 time: 0.149284 Jun 16 12:36:18.115752 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 478/965] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:36:17 2022] GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:36:18.721598 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e39787de-1af1-47f5-bc4f-1fafad3cc6e2 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:36:18.722264 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e39787de-1af1-47f5-bc4f-1fafad3cc6e2 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] [instance: 198edd63-e22e-42ca-8c37-89b4f87bab60] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:36:18.729621 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e39787de-1af1-47f5-bc4f-1fafad3cc6e2 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:18.730106 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e39787de-1af1-47f5-bc4f-1fafad3cc6e2 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:18.730874 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e39787de-1af1-47f5-bc4f-1fafad3cc6e2 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:18.731311 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e39787de-1af1-47f5-bc4f-1fafad3cc6e2 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:18.862694 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e39787de-1af1-47f5-bc4f-1fafad3cc6e2 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f18557a45846c1bd9075f8a0717652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf2d3eca81148afa04159506decfdce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:36:18.870691 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e39787de-1af1-47f5-bc4f-1fafad3cc6e2 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] 10.222.0.45 "GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60" status: 200 len: 1569 microversion: 2.1 time: 0.152950 Jun 16 12:36:18.871259 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 488/966] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:36:18 2022] GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:36:19.134550 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-75f50ed8-ff53-4f4a-81bc-df3415ca0d94 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:36:19.135794 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-75f50ed8-ff53-4f4a-81bc-df3415ca0d94 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: 8e91b2d7-1250-4cca-965d-c18107d8c3a1] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:36:19.142944 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-75f50ed8-ff53-4f4a-81bc-df3415ca0d94 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:19.143392 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-75f50ed8-ff53-4f4a-81bc-df3415ca0d94 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:19.144151 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-75f50ed8-ff53-4f4a-81bc-df3415ca0d94 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:19.144606 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-75f50ed8-ff53-4f4a-81bc-df3415ca0d94 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:19.278022 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-75f50ed8-ff53-4f4a-81bc-df3415ca0d94 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e53fdd4ca2b4fd8b64caea6924fa969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb62ca3babf9402996e0ef47fc0d8e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:36:19.285889 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-75f50ed8-ff53-4f4a-81bc-df3415ca0d94 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1" status: 200 len: 1722 microversion: 2.1 time: 0.156969 Jun 16 12:36:19.286462 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 479/967] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:36:19 2022] GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:36:19.888271 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-23495529-4eea-4b9c-95de-5809bc8f210d tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:36:19.888865 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-23495529-4eea-4b9c-95de-5809bc8f210d tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] [instance: 198edd63-e22e-42ca-8c37-89b4f87bab60] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:36:19.895312 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-23495529-4eea-4b9c-95de-5809bc8f210d tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:19.895752 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-23495529-4eea-4b9c-95de-5809bc8f210d tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:19.896507 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-23495529-4eea-4b9c-95de-5809bc8f210d tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:19.896934 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-23495529-4eea-4b9c-95de-5809bc8f210d tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:20.030826 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-23495529-4eea-4b9c-95de-5809bc8f210d tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f18557a45846c1bd9075f8a0717652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf2d3eca81148afa04159506decfdce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:36:20.038235 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-23495529-4eea-4b9c-95de-5809bc8f210d tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] 10.222.0.45 "GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60" status: 200 len: 1510 microversion: 2.1 time: 0.153788 Jun 16 12:36:20.039287 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 489/968] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:36:19 2022] GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60 => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:36:20.055130 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6ed35b10-2f30-4948-9c22-f5b05c8ba5ba tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:36:20.055706 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6ed35b10-2f30-4948-9c22-f5b05c8ba5ba tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] [instance: 198edd63-e22e-42ca-8c37-89b4f87bab60] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:36:20.061647 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6ed35b10-2f30-4948-9c22-f5b05c8ba5ba tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:20.062137 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6ed35b10-2f30-4948-9c22-f5b05c8ba5ba tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:20.062901 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6ed35b10-2f30-4948-9c22-f5b05c8ba5ba tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:20.063343 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6ed35b10-2f30-4948-9c22-f5b05c8ba5ba tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:20.137500 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6ed35b10-2f30-4948-9c22-f5b05c8ba5ba tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] 10.222.0.45 "POST /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60/action" status: 202 len: 0 microversion: 2.1 time: 0.086358 Jun 16 12:36:20.138204 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 480/969] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Jun 16 12:36:20 2022] POST /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 12:36:20.146245 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-dc466b43-5701-4523-a26c-0f96f637c322 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:36:20.146783 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-dc466b43-5701-4523-a26c-0f96f637c322 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] [instance: 198edd63-e22e-42ca-8c37-89b4f87bab60] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:36:20.153543 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dc466b43-5701-4523-a26c-0f96f637c322 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:20.154027 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dc466b43-5701-4523-a26c-0f96f637c322 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:20.154786 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dc466b43-5701-4523-a26c-0f96f637c322 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:20.155321 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dc466b43-5701-4523-a26c-0f96f637c322 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:20.299049 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-dc466b43-5701-4523-a26c-0f96f637c322 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f18557a45846c1bd9075f8a0717652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf2d3eca81148afa04159506decfdce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:36:20.304254 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7cf5c09f-1b74-4334-b07c-2244b61f6985 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:36:20.305269 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7cf5c09f-1b74-4334-b07c-2244b61f6985 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: 8e91b2d7-1250-4cca-965d-c18107d8c3a1] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:36:20.307192 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-dc466b43-5701-4523-a26c-0f96f637c322 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] 10.222.0.45 "GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60" status: 200 len: 1518 microversion: 2.1 time: 0.164837 Jun 16 12:36:20.307935 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 490/970] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:36:20 2022] GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60 => generated 1518 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:36:20.316296 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7cf5c09f-1b74-4334-b07c-2244b61f6985 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:20.316761 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7cf5c09f-1b74-4334-b07c-2244b61f6985 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:20.317628 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7cf5c09f-1b74-4334-b07c-2244b61f6985 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:20.318105 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7cf5c09f-1b74-4334-b07c-2244b61f6985 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:20.454348 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7cf5c09f-1b74-4334-b07c-2244b61f6985 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e53fdd4ca2b4fd8b64caea6924fa969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb62ca3babf9402996e0ef47fc0d8e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:36:20.462793 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7cf5c09f-1b74-4334-b07c-2244b61f6985 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1" status: 200 len: 1722 microversion: 2.1 time: 0.162880 Jun 16 12:36:20.463467 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 481/971] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:36:20 2022] GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:36:21.324612 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-04a47383-87a4-4f1f-a776-d2257dfcd0ff tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:36:21.325789 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-04a47383-87a4-4f1f-a776-d2257dfcd0ff tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] [instance: 198edd63-e22e-42ca-8c37-89b4f87bab60] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:36:21.332440 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-04a47383-87a4-4f1f-a776-d2257dfcd0ff tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:21.332880 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-04a47383-87a4-4f1f-a776-d2257dfcd0ff tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:21.333636 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-04a47383-87a4-4f1f-a776-d2257dfcd0ff tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:21.334103 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-04a47383-87a4-4f1f-a776-d2257dfcd0ff tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:21.474897 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-04a47383-87a4-4f1f-a776-d2257dfcd0ff tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f18557a45846c1bd9075f8a0717652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf2d3eca81148afa04159506decfdce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:36:21.480777 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9f6e849c-ff78-48f9-a587-5c7356917787 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:36:21.481487 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9f6e849c-ff78-48f9-a587-5c7356917787 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: 8e91b2d7-1250-4cca-965d-c18107d8c3a1] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:36:21.484030 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-04a47383-87a4-4f1f-a776-d2257dfcd0ff tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] 10.222.0.45 "GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60" status: 200 len: 1520 microversion: 2.1 time: 0.164201 Jun 16 12:36:21.485905 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 491/972] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:36:21 2022] GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:36:21.488905 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9f6e849c-ff78-48f9-a587-5c7356917787 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:21.489361 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9f6e849c-ff78-48f9-a587-5c7356917787 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:21.490178 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9f6e849c-ff78-48f9-a587-5c7356917787 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:21.490700 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9f6e849c-ff78-48f9-a587-5c7356917787 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:21.625410 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9f6e849c-ff78-48f9-a587-5c7356917787 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e53fdd4ca2b4fd8b64caea6924fa969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb62ca3babf9402996e0ef47fc0d8e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:36:21.633461 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9f6e849c-ff78-48f9-a587-5c7356917787 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1" status: 200 len: 1722 microversion: 2.1 time: 0.157025 Jun 16 12:36:21.634073 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 482/973] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:36:21 2022] GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:36:22.503241 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-cf89fc6f-4de3-4628-a706-15c19d740638 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:36:22.503862 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-cf89fc6f-4de3-4628-a706-15c19d740638 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] [instance: 198edd63-e22e-42ca-8c37-89b4f87bab60] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:36:22.510584 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cf89fc6f-4de3-4628-a706-15c19d740638 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:22.511038 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cf89fc6f-4de3-4628-a706-15c19d740638 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:22.511822 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cf89fc6f-4de3-4628-a706-15c19d740638 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:22.512249 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cf89fc6f-4de3-4628-a706-15c19d740638 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:22.643780 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-cf89fc6f-4de3-4628-a706-15c19d740638 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f18557a45846c1bd9075f8a0717652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf2d3eca81148afa04159506decfdce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:36:22.650834 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-44605730-7c26-4b37-8988-4425a9bf9839 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:36:22.651447 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-44605730-7c26-4b37-8988-4425a9bf9839 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: 8e91b2d7-1250-4cca-965d-c18107d8c3a1] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:36:22.652720 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-cf89fc6f-4de3-4628-a706-15c19d740638 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] 10.222.0.45 "GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60" status: 200 len: 1576 microversion: 2.1 time: 0.153131 Jun 16 12:36:22.653458 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 492/974] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:36:22 2022] GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:36:22.658240 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-44605730-7c26-4b37-8988-4425a9bf9839 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:22.658694 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-44605730-7c26-4b37-8988-4425a9bf9839 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:22.659457 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-44605730-7c26-4b37-8988-4425a9bf9839 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:22.659891 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-44605730-7c26-4b37-8988-4425a9bf9839 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:22.794636 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-44605730-7c26-4b37-8988-4425a9bf9839 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e53fdd4ca2b4fd8b64caea6924fa969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb62ca3babf9402996e0ef47fc0d8e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:36:22.802520 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-44605730-7c26-4b37-8988-4425a9bf9839 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1" status: 200 len: 1722 microversion: 2.1 time: 0.156031 Jun 16 12:36:22.803079 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 483/975] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:36:22 2022] GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:36:23.022740 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-c51f82a6-5ffa-47fa-9a7f-9eb996a28969 req-8718e125-1063-489b-8c6d-ae1692586b04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "198edd63-e22e-42ca-8c37-89b4f87bab60", "name": "network-vif-unplugged", "status": "completed", "tag": "9d06019c-16e2-447d-a476-b5bcbaca8ea9"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:36:23.032108 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-c51f82a6-5ffa-47fa-9a7f-9eb996a28969 req-8718e125-1063-489b-8c6d-ae1692586b04 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:23.032607 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-c51f82a6-5ffa-47fa-9a7f-9eb996a28969 req-8718e125-1063-489b-8c6d-ae1692586b04 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:23.043619 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-c51f82a6-5ffa-47fa-9a7f-9eb996a28969 req-8718e125-1063-489b-8c6d-ae1692586b04 service nova] Creating event network-vif-unplugged:9d06019c-16e2-447d-a476-b5bcbaca8ea9 for instance 198edd63-e22e-42ca-8c37-89b4f87bab60 on hv-cinder-84614 Jun 16 12:36:23.048543 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-c51f82a6-5ffa-47fa-9a7f-9eb996a28969 req-8718e125-1063-489b-8c6d-ae1692586b04 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029441 Jun 16 12:36:23.049299 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 493/976] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:36:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:36:23.671312 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-002d7b67-abcd-4db6-b1bf-32ad760856d4 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:36:23.671925 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-002d7b67-abcd-4db6-b1bf-32ad760856d4 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] [instance: 198edd63-e22e-42ca-8c37-89b4f87bab60] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:36:23.678382 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-002d7b67-abcd-4db6-b1bf-32ad760856d4 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:23.678833 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-002d7b67-abcd-4db6-b1bf-32ad760856d4 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:23.680293 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-002d7b67-abcd-4db6-b1bf-32ad760856d4 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:23.680627 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-002d7b67-abcd-4db6-b1bf-32ad760856d4 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:23.809165 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-002d7b67-abcd-4db6-b1bf-32ad760856d4 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f18557a45846c1bd9075f8a0717652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf2d3eca81148afa04159506decfdce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:36:23.816638 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-002d7b67-abcd-4db6-b1bf-32ad760856d4 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] 10.222.0.45 "GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60" status: 200 len: 1576 microversion: 2.1 time: 0.149140 Jun 16 12:36:23.817196 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 484/977] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:36:23 2022] GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60 => generated 1576 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:36:23.821442 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e5c386da-848e-4055-bd27-0e2b85595231 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:36:23.822273 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e5c386da-848e-4055-bd27-0e2b85595231 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: 8e91b2d7-1250-4cca-965d-c18107d8c3a1] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:36:23.828557 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e5c386da-848e-4055-bd27-0e2b85595231 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:23.829011 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e5c386da-848e-4055-bd27-0e2b85595231 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:23.829777 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e5c386da-848e-4055-bd27-0e2b85595231 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:23.830242 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e5c386da-848e-4055-bd27-0e2b85595231 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:23.955827 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e5c386da-848e-4055-bd27-0e2b85595231 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e53fdd4ca2b4fd8b64caea6924fa969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb62ca3babf9402996e0ef47fc0d8e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:36:23.963985 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e5c386da-848e-4055-bd27-0e2b85595231 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1" status: 200 len: 1722 microversion: 2.1 time: 0.147694 Jun 16 12:36:23.964551 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 494/978] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:36:23 2022] GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:36:24.833538 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d0e3bfb2-4652-4303-b478-ce4a33345316 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:36:24.834175 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d0e3bfb2-4652-4303-b478-ce4a33345316 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] [instance: 198edd63-e22e-42ca-8c37-89b4f87bab60] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:36:24.840780 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d0e3bfb2-4652-4303-b478-ce4a33345316 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:24.841233 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d0e3bfb2-4652-4303-b478-ce4a33345316 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:24.842020 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d0e3bfb2-4652-4303-b478-ce4a33345316 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:24.842468 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d0e3bfb2-4652-4303-b478-ce4a33345316 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:24.975358 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d0e3bfb2-4652-4303-b478-ce4a33345316 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f18557a45846c1bd9075f8a0717652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf2d3eca81148afa04159506decfdce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:36:24.980685 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c816c552-0652-4ce4-a28f-3def4e57e946 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:36:24.981300 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c816c552-0652-4ce4-a28f-3def4e57e946 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: 8e91b2d7-1250-4cca-965d-c18107d8c3a1] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:36:24.983666 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d0e3bfb2-4652-4303-b478-ce4a33345316 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] 10.222.0.45 "GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60" status: 200 len: 1576 microversion: 2.1 time: 0.153999 Jun 16 12:36:24.984235 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 485/979] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:36:24 2022] GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:36:24.987861 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c816c552-0652-4ce4-a28f-3def4e57e946 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:24.988310 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c816c552-0652-4ce4-a28f-3def4e57e946 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:24.989073 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c816c552-0652-4ce4-a28f-3def4e57e946 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:24.989517 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c816c552-0652-4ce4-a28f-3def4e57e946 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:24.992458 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:36:25.118529 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c816c552-0652-4ce4-a28f-3def4e57e946 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e53fdd4ca2b4fd8b64caea6924fa969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb62ca3babf9402996e0ef47fc0d8e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:36:25.126522 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c816c552-0652-4ce4-a28f-3def4e57e946 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1" status: 200 len: 1722 microversion: 2.1 time: 0.150605 Jun 16 12:36:25.127084 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 495/980] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:36:24 2022] GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:36:26.006182 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ebb57542-136a-42b5-bea3-d6f5f6a9333b tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:36:26.006825 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ebb57542-136a-42b5-bea3-d6f5f6a9333b tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] [instance: 198edd63-e22e-42ca-8c37-89b4f87bab60] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:36:26.013744 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ebb57542-136a-42b5-bea3-d6f5f6a9333b tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:26.014236 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ebb57542-136a-42b5-bea3-d6f5f6a9333b tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:26.014988 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ebb57542-136a-42b5-bea3-d6f5f6a9333b tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:26.015420 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ebb57542-136a-42b5-bea3-d6f5f6a9333b tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:26.143883 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7419000e-09af-47a0-8b33-74d2e7a719ff tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:36:26.144533 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7419000e-09af-47a0-8b33-74d2e7a719ff tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: 8e91b2d7-1250-4cca-965d-c18107d8c3a1] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:36:26.150667 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ebb57542-136a-42b5-bea3-d6f5f6a9333b tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f18557a45846c1bd9075f8a0717652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf2d3eca81148afa04159506decfdce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:36:26.151169 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7419000e-09af-47a0-8b33-74d2e7a719ff tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:26.151629 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7419000e-09af-47a0-8b33-74d2e7a719ff tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:26.152658 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7419000e-09af-47a0-8b33-74d2e7a719ff tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:26.153102 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7419000e-09af-47a0-8b33-74d2e7a719ff tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:26.158501 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ebb57542-136a-42b5-bea3-d6f5f6a9333b tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] 10.222.0.45 "GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60" status: 200 len: 1576 microversion: 2.1 time: 0.156224 Jun 16 12:36:26.159061 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 486/981] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:36:25 2022] GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60 => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:36:26.280095 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7419000e-09af-47a0-8b33-74d2e7a719ff tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e53fdd4ca2b4fd8b64caea6924fa969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb62ca3babf9402996e0ef47fc0d8e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:36:26.287922 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7419000e-09af-47a0-8b33-74d2e7a719ff tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1" status: 200 len: 1722 microversion: 2.1 time: 0.148052 Jun 16 12:36:26.288995 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 496/982] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:36:26 2022] GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:36:27.176470 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-af046c08-1138-4ab8-b0bd-e6835470f747 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:36:27.177088 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-af046c08-1138-4ab8-b0bd-e6835470f747 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] [instance: 198edd63-e22e-42ca-8c37-89b4f87bab60] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:36:27.184436 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-af046c08-1138-4ab8-b0bd-e6835470f747 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:27.184895 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-af046c08-1138-4ab8-b0bd-e6835470f747 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:27.185677 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-af046c08-1138-4ab8-b0bd-e6835470f747 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:27.186124 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-af046c08-1138-4ab8-b0bd-e6835470f747 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:27.190015 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:36:27.306755 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5fb5e8c1-f8a8-44a5-b525-1c3e9e79db9b tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:36:27.307476 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5fb5e8c1-f8a8-44a5-b525-1c3e9e79db9b tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: 8e91b2d7-1250-4cca-965d-c18107d8c3a1] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:36:27.314126 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5fb5e8c1-f8a8-44a5-b525-1c3e9e79db9b tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:27.314655 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5fb5e8c1-f8a8-44a5-b525-1c3e9e79db9b tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:27.315425 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5fb5e8c1-f8a8-44a5-b525-1c3e9e79db9b tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:27.315857 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5fb5e8c1-f8a8-44a5-b525-1c3e9e79db9b tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:27.326603 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-af046c08-1138-4ab8-b0bd-e6835470f747 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f18557a45846c1bd9075f8a0717652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf2d3eca81148afa04159506decfdce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:36:27.334115 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-af046c08-1138-4ab8-b0bd-e6835470f747 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] 10.222.0.45 "GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60" status: 200 len: 1576 microversion: 2.1 time: 0.161478 Jun 16 12:36:27.334691 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 487/983] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:36:27 2022] GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60 => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:36:27.700769 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5fb5e8c1-f8a8-44a5-b525-1c3e9e79db9b tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e53fdd4ca2b4fd8b64caea6924fa969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb62ca3babf9402996e0ef47fc0d8e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:36:27.708592 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5fb5e8c1-f8a8-44a5-b525-1c3e9e79db9b tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1" status: 200 len: 1722 microversion: 2.1 time: 0.406919 Jun 16 12:36:27.709147 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 497/984] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:36:27 2022] GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1 => generated 1722 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:36:28.350637 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-aa3eade5-0131-47cc-a4a8-38cee0cf3034 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:36:28.351366 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-aa3eade5-0131-47cc-a4a8-38cee0cf3034 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] [instance: 198edd63-e22e-42ca-8c37-89b4f87bab60] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:36:28.357955 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-aa3eade5-0131-47cc-a4a8-38cee0cf3034 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:28.358410 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-aa3eade5-0131-47cc-a4a8-38cee0cf3034 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:28.359176 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-aa3eade5-0131-47cc-a4a8-38cee0cf3034 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:28.359615 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-aa3eade5-0131-47cc-a4a8-38cee0cf3034 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:28.488511 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-aa3eade5-0131-47cc-a4a8-38cee0cf3034 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f18557a45846c1bd9075f8a0717652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf2d3eca81148afa04159506decfdce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:36:28.496483 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-aa3eade5-0131-47cc-a4a8-38cee0cf3034 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] 10.222.0.45 "GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60" status: 200 len: 1576 microversion: 2.1 time: 0.149784 Jun 16 12:36:28.497035 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 488/985] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:36:28 2022] GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60 => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:36:28.726688 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c781d415-f114-4aaf-b4f6-2830258d3762 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:36:28.727315 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c781d415-f114-4aaf-b4f6-2830258d3762 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: 8e91b2d7-1250-4cca-965d-c18107d8c3a1] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:36:28.733817 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c781d415-f114-4aaf-b4f6-2830258d3762 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:28.734290 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c781d415-f114-4aaf-b4f6-2830258d3762 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:28.735047 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c781d415-f114-4aaf-b4f6-2830258d3762 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:28.735475 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c781d415-f114-4aaf-b4f6-2830258d3762 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:28.860562 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c781d415-f114-4aaf-b4f6-2830258d3762 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e53fdd4ca2b4fd8b64caea6924fa969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb62ca3babf9402996e0ef47fc0d8e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:36:28.868403 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c781d415-f114-4aaf-b4f6-2830258d3762 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1" status: 200 len: 1722 microversion: 2.1 time: 0.146234 Jun 16 12:36:28.868955 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 498/986] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:36:28 2022] GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1 => generated 1722 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:36:29.513534 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e6186e85-2ff5-46ad-85a3-62a7e45a074f tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:36:29.514168 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e6186e85-2ff5-46ad-85a3-62a7e45a074f tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] [instance: 198edd63-e22e-42ca-8c37-89b4f87bab60] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:36:29.520346 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e6186e85-2ff5-46ad-85a3-62a7e45a074f tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:29.520794 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e6186e85-2ff5-46ad-85a3-62a7e45a074f tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:29.521551 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e6186e85-2ff5-46ad-85a3-62a7e45a074f tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:29.522017 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e6186e85-2ff5-46ad-85a3-62a7e45a074f tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:29.702946 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e6186e85-2ff5-46ad-85a3-62a7e45a074f tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f18557a45846c1bd9075f8a0717652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf2d3eca81148afa04159506decfdce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:36:29.710672 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e6186e85-2ff5-46ad-85a3-62a7e45a074f tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] 10.222.0.45 "GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60" status: 200 len: 1576 microversion: 2.1 time: 0.200746 Jun 16 12:36:29.711018 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 489/987] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:36:29 2022] GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60 => generated 1576 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:36:29.885669 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ef28af2f-be8d-4035-b734-57684bb7dcf0 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:36:29.886238 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ef28af2f-be8d-4035-b734-57684bb7dcf0 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: 8e91b2d7-1250-4cca-965d-c18107d8c3a1] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:36:29.892690 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ef28af2f-be8d-4035-b734-57684bb7dcf0 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:29.893138 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ef28af2f-be8d-4035-b734-57684bb7dcf0 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:29.893928 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ef28af2f-be8d-4035-b734-57684bb7dcf0 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:29.894371 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ef28af2f-be8d-4035-b734-57684bb7dcf0 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:30.022330 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ef28af2f-be8d-4035-b734-57684bb7dcf0 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e53fdd4ca2b4fd8b64caea6924fa969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb62ca3babf9402996e0ef47fc0d8e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:36:30.030429 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ef28af2f-be8d-4035-b734-57684bb7dcf0 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1" status: 200 len: 1722 microversion: 2.1 time: 0.148918 Jun 16 12:36:30.030993 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 499/988] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:36:29 2022] GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:36:30.727764 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-552777b3-09c9-4a1e-abbb-3ec8c9dd27ce tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:36:30.728290 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-552777b3-09c9-4a1e-abbb-3ec8c9dd27ce tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] [instance: 198edd63-e22e-42ca-8c37-89b4f87bab60] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:36:30.734744 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-552777b3-09c9-4a1e-abbb-3ec8c9dd27ce tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:30.735196 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-552777b3-09c9-4a1e-abbb-3ec8c9dd27ce tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:30.735952 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-552777b3-09c9-4a1e-abbb-3ec8c9dd27ce tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:30.736409 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-552777b3-09c9-4a1e-abbb-3ec8c9dd27ce tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:30.868044 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-552777b3-09c9-4a1e-abbb-3ec8c9dd27ce tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f18557a45846c1bd9075f8a0717652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf2d3eca81148afa04159506decfdce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:36:30.875936 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-552777b3-09c9-4a1e-abbb-3ec8c9dd27ce tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] 10.222.0.45 "GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60" status: 200 len: 1576 microversion: 2.1 time: 0.152364 Jun 16 12:36:30.876521 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 490/989] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:36:30 2022] GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:36:31.048130 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-46566b1a-7a89-43ab-80e1-174bbf0b5a05 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:36:31.048690 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-46566b1a-7a89-43ab-80e1-174bbf0b5a05 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: 8e91b2d7-1250-4cca-965d-c18107d8c3a1] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:36:31.050952 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=46 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:36:31.057322 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-46566b1a-7a89-43ab-80e1-174bbf0b5a05 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:31.057782 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-46566b1a-7a89-43ab-80e1-174bbf0b5a05 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:31.058586 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-46566b1a-7a89-43ab-80e1-174bbf0b5a05 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:31.059032 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-46566b1a-7a89-43ab-80e1-174bbf0b5a05 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:31.192700 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-46566b1a-7a89-43ab-80e1-174bbf0b5a05 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e53fdd4ca2b4fd8b64caea6924fa969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb62ca3babf9402996e0ef47fc0d8e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:36:31.202053 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-46566b1a-7a89-43ab-80e1-174bbf0b5a05 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1" status: 200 len: 1699 microversion: 2.1 time: 0.157834 Jun 16 12:36:31.202635 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 500/990] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:36:31 2022] GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1 => generated 1699 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:36:31.219029 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9c4a6765-d37f-476c-97d4-a631ef5d0d72 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:36:31.225164 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9c4a6765-d37f-476c-97d4-a631ef5d0d72 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:31.225653 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9c4a6765-d37f-476c-97d4-a631ef5d0d72 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:31.285915 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9c4a6765-d37f-476c-97d4-a631ef5d0d72 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: 8e91b2d7-1250-4cca-965d-c18107d8c3a1] Going to try to start instance {{(pid=117606) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 16 12:36:31.328771 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9c4a6765-d37f-476c-97d4-a631ef5d0d72 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "POST /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1/action" status: 202 len: 0 microversion: 2.1 time: 0.113476 Jun 16 12:36:31.329342 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 491/991] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Jun 16 12:36:31 2022] POST /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 12:36:31.337629 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-96d8822d-30f9-4315-89dd-328f0758bd83 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:36:31.338266 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-96d8822d-30f9-4315-89dd-328f0758bd83 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: 8e91b2d7-1250-4cca-965d-c18107d8c3a1] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:36:31.344225 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-96d8822d-30f9-4315-89dd-328f0758bd83 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:31.344669 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-96d8822d-30f9-4315-89dd-328f0758bd83 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:31.345424 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-96d8822d-30f9-4315-89dd-328f0758bd83 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:31.345852 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-96d8822d-30f9-4315-89dd-328f0758bd83 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:31.481489 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-96d8822d-30f9-4315-89dd-328f0758bd83 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e53fdd4ca2b4fd8b64caea6924fa969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb62ca3babf9402996e0ef47fc0d8e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:36:31.489501 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-96d8822d-30f9-4315-89dd-328f0758bd83 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1" status: 200 len: 1708 microversion: 2.1 time: 0.155990 Jun 16 12:36:31.490093 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 501/992] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:36:31 2022] GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1 => generated 1708 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:36:31.893447 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0161d4f3-6f21-41f3-9d7c-f08668117673 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:36:31.894188 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0161d4f3-6f21-41f3-9d7c-f08668117673 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] [instance: 198edd63-e22e-42ca-8c37-89b4f87bab60] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:36:31.900954 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0161d4f3-6f21-41f3-9d7c-f08668117673 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:31.901407 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0161d4f3-6f21-41f3-9d7c-f08668117673 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:31.902463 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0161d4f3-6f21-41f3-9d7c-f08668117673 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:31.902902 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0161d4f3-6f21-41f3-9d7c-f08668117673 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:32.105018 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0161d4f3-6f21-41f3-9d7c-f08668117673 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f18557a45846c1bd9075f8a0717652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf2d3eca81148afa04159506decfdce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:36:32.112529 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0161d4f3-6f21-41f3-9d7c-f08668117673 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] 10.222.0.45 "GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60" status: 200 len: 1563 microversion: 2.1 time: 0.223670 Jun 16 12:36:32.113031 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 492/993] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:36:31 2022] GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60 => generated 1563 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:36:32.508479 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f6465faf-cf88-4abf-af5b-0bdd8223846c tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:36:32.509080 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f6465faf-cf88-4abf-af5b-0bdd8223846c tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: 8e91b2d7-1250-4cca-965d-c18107d8c3a1] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:36:32.515510 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f6465faf-cf88-4abf-af5b-0bdd8223846c tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:32.515950 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f6465faf-cf88-4abf-af5b-0bdd8223846c tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:32.516704 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f6465faf-cf88-4abf-af5b-0bdd8223846c tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:32.517133 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f6465faf-cf88-4abf-af5b-0bdd8223846c tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:32.648440 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f6465faf-cf88-4abf-af5b-0bdd8223846c tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e53fdd4ca2b4fd8b64caea6924fa969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb62ca3babf9402996e0ef47fc0d8e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:36:32.656585 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f6465faf-cf88-4abf-af5b-0bdd8223846c tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1" status: 200 len: 1708 microversion: 2.1 time: 0.152556 Jun 16 12:36:32.657159 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 502/994] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:36:32 2022] GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1 => generated 1708 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:36:33.115597 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-7a4724d7-9173-4efe-8e5a-abfee8d2b565 req-66a45863-f73c-4ec1-a134-fc635cb75062 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "198edd63-e22e-42ca-8c37-89b4f87bab60", "name": "network-vif-plugged", "status": "completed", "tag": "9d06019c-16e2-447d-a476-b5bcbaca8ea9"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:36:33.125249 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-7a4724d7-9173-4efe-8e5a-abfee8d2b565 req-66a45863-f73c-4ec1-a134-fc635cb75062 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:33.125747 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-7a4724d7-9173-4efe-8e5a-abfee8d2b565 req-66a45863-f73c-4ec1-a134-fc635cb75062 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:33.138338 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-7a4724d7-9173-4efe-8e5a-abfee8d2b565 req-66a45863-f73c-4ec1-a134-fc635cb75062 service nova] Creating event network-vif-plugged:9d06019c-16e2-447d-a476-b5bcbaca8ea9 for instance 198edd63-e22e-42ca-8c37-89b4f87bab60 on hv-cinder-84614 Jun 16 12:36:33.143578 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-7a4724d7-9173-4efe-8e5a-abfee8d2b565 req-66a45863-f73c-4ec1-a134-fc635cb75062 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031856 Jun 16 12:36:33.144432 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 493/995] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:36:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 12:36:33.673161 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-76d42163-d02a-489d-9ff5-880b09a68136 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:36:33.673782 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-76d42163-d02a-489d-9ff5-880b09a68136 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: 8e91b2d7-1250-4cca-965d-c18107d8c3a1] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:36:33.680342 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-76d42163-d02a-489d-9ff5-880b09a68136 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:33.680820 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-76d42163-d02a-489d-9ff5-880b09a68136 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:33.681592 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-76d42163-d02a-489d-9ff5-880b09a68136 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:33.682071 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-76d42163-d02a-489d-9ff5-880b09a68136 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:33.813365 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-76d42163-d02a-489d-9ff5-880b09a68136 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e53fdd4ca2b4fd8b64caea6924fa969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb62ca3babf9402996e0ef47fc0d8e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:36:33.821779 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-76d42163-d02a-489d-9ff5-880b09a68136 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1" status: 200 len: 1712 microversion: 2.1 time: 0.152520 Jun 16 12:36:33.822372 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 503/996] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:36:33 2022] GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1 => generated 1712 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:36:53.065973 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-56a86941-7437-4914-a06c-5f660ad8f831 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:36:53.066535 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-56a86941-7437-4914-a06c-5f660ad8f831 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: a3051ffe-ff68-4737-9838-12cb61b509a8] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:36:53.069582 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=51 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:36:53.070256 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:36:53.076824 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-56a86941-7437-4914-a06c-5f660ad8f831 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:53.077308 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-56a86941-7437-4914-a06c-5f660ad8f831 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:53.078118 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-56a86941-7437-4914-a06c-5f660ad8f831 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:53.078557 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-56a86941-7437-4914-a06c-5f660ad8f831 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:53.102586 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-56a86941-7437-4914-a06c-5f660ad8f831 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/a3051ffe-ff68-4737-9838-12cb61b509a8/ips" status: 200 len: 150 microversion: 2.1 time: 0.040895 Jun 16 12:36:53.103136 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 494/997] 10.222.0.45 () {58 vars in 1247 bytes} [Thu Jun 16 12:36:53 2022] GET /compute/v2.1/servers/a3051ffe-ff68-4737-9838-12cb61b509a8/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:36:54.416399 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-26060b92-90b3-4c5c-9e9d-1de98d84951b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "abafa693-38e9-4c0a-b778-4d2f3ccaa228"}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:36:54.417548 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-26060b92-90b3-4c5c-9e9d-1de98d84951b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: a3051ffe-ff68-4737-9838-12cb61b509a8] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:36:54.420161 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=7 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:36:54.420966 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=53 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:36:54.426403 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-26060b92-90b3-4c5c-9e9d-1de98d84951b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:54.426859 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-26060b92-90b3-4c5c-9e9d-1de98d84951b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:54.427625 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-26060b92-90b3-4c5c-9e9d-1de98d84951b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:36:54.428061 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-26060b92-90b3-4c5c-9e9d-1de98d84951b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:36:54.678082 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-26060b92-90b3-4c5c-9e9d-1de98d84951b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "POST /compute/v2.1/servers/a3051ffe-ff68-4737-9838-12cb61b509a8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.266010 Jun 16 12:36:54.678756 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 504/998] 10.222.0.45 () {60 vars in 1322 bytes} [Thu Jun 16 12:36:54 2022] POST /compute/v2.1/servers/a3051ffe-ff68-4737-9838-12cb61b509a8/os-volume_attachments => generated 194 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:37:02.268172 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c567a8e1-7c0d-4406-bfbe-fb85c530fac9 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:37:02.268667 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c567a8e1-7c0d-4406-bfbe-fb85c530fac9 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: a3051ffe-ff68-4737-9838-12cb61b509a8] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:37:02.274853 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c567a8e1-7c0d-4406-bfbe-fb85c530fac9 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:02.275302 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c567a8e1-7c0d-4406-bfbe-fb85c530fac9 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:02.276062 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c567a8e1-7c0d-4406-bfbe-fb85c530fac9 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:02.276501 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c567a8e1-7c0d-4406-bfbe-fb85c530fac9 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:02.455163 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.objects.instance [None req-c567a8e1-7c0d-4406-bfbe-fb85c530fac9 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lazy-loading 'services' on Instance uuid a3051ffe-ff68-4737-9838-12cb61b509a8 {{(pid=117606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 12:37:02.531006 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c567a8e1-7c0d-4406-bfbe-fb85c530fac9 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "DELETE /compute/v2.1/servers/a3051ffe-ff68-4737-9838-12cb61b509a8/os-volume_attachments/abafa693-38e9-4c0a-b778-4d2f3ccaa228" status: 202 len: 0 microversion: 2.1 time: 0.266535 Jun 16 12:37:02.532074 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 495/999] 10.222.0.45 () {58 vars in 1415 bytes} [Thu Jun 16 12:37:02 2022] DELETE /compute/v2.1/servers/a3051ffe-ff68-4737-9838-12cb61b509a8/os-volume_attachments/abafa693-38e9-4c0a-b778-4d2f3ccaa228 => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 12:37:02.541663 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-67ac5a28-2ffb-42db-aad2-1e458632b172 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:37:02.548501 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-67ac5a28-2ffb-42db-aad2-1e458632b172 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: a3051ffe-ff68-4737-9838-12cb61b509a8] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:37:02.556065 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-67ac5a28-2ffb-42db-aad2-1e458632b172 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:02.556477 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-67ac5a28-2ffb-42db-aad2-1e458632b172 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:02.557287 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-67ac5a28-2ffb-42db-aad2-1e458632b172 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:02.557714 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-67ac5a28-2ffb-42db-aad2-1e458632b172 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:02.588522 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-67ac5a28-2ffb-42db-aad2-1e458632b172 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/a3051ffe-ff68-4737-9838-12cb61b509a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051767 Jun 16 12:37:02.589095 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 505/1000] 10.222.0.45 () {58 vars in 1301 bytes} [Thu Jun 16 12:37:02 2022] GET /compute/v2.1/servers/a3051ffe-ff68-4737-9838-12cb61b509a8/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 12:37:03.601791 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d198be36-206a-4ae8-9c85-80500d3dff2f tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:37:03.602818 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d198be36-206a-4ae8-9c85-80500d3dff2f tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: a3051ffe-ff68-4737-9838-12cb61b509a8] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:37:03.609055 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d198be36-206a-4ae8-9c85-80500d3dff2f tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:03.609506 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d198be36-206a-4ae8-9c85-80500d3dff2f tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:03.610308 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d198be36-206a-4ae8-9c85-80500d3dff2f tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:03.610749 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d198be36-206a-4ae8-9c85-80500d3dff2f tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:03.641400 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d198be36-206a-4ae8-9c85-80500d3dff2f tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/a3051ffe-ff68-4737-9838-12cb61b509a8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045176 Jun 16 12:37:03.642153 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 496/1001] 10.222.0.45 () {58 vars in 1301 bytes} [Thu Jun 16 12:37:03 2022] GET /compute/v2.1/servers/a3051ffe-ff68-4737-9838-12cb61b509a8/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 12:37:03.700055 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-306c4442-70e5-4086-8422-ede93bc9ee58 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:37:03.700575 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-306c4442-70e5-4086-8422-ede93bc9ee58 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: a3051ffe-ff68-4737-9838-12cb61b509a8] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:37:03.706988 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-306c4442-70e5-4086-8422-ede93bc9ee58 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:03.707460 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-306c4442-70e5-4086-8422-ede93bc9ee58 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:03.708208 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-306c4442-70e5-4086-8422-ede93bc9ee58 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:03.708648 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-306c4442-70e5-4086-8422-ede93bc9ee58 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:03.733841 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-306c4442-70e5-4086-8422-ede93bc9ee58 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: a3051ffe-ff68-4737-9838-12cb61b509a8] Going to try to terminate instance {{(pid=117607) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 12:37:03.812875 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-306c4442-70e5-4086-8422-ede93bc9ee58 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "DELETE /compute/v2.1/servers/a3051ffe-ff68-4737-9838-12cb61b509a8" status: 204 len: 0 microversion: 2.1 time: 0.116307 Jun 16 12:37:03.813853 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 506/1002] 10.222.0.45 () {58 vars in 1238 bytes} [Thu Jun 16 12:37:03 2022] DELETE /compute/v2.1/servers/a3051ffe-ff68-4737-9838-12cb61b509a8 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 12:37:03.822017 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0fa9777b-c687-4be7-8c01-6b5a62c63a29 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:37:03.822659 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0fa9777b-c687-4be7-8c01-6b5a62c63a29 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: a3051ffe-ff68-4737-9838-12cb61b509a8] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:37:03.828555 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0fa9777b-c687-4be7-8c01-6b5a62c63a29 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:03.828996 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0fa9777b-c687-4be7-8c01-6b5a62c63a29 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:03.829748 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0fa9777b-c687-4be7-8c01-6b5a62c63a29 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:03.830206 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0fa9777b-c687-4be7-8c01-6b5a62c63a29 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:03.962521 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0fa9777b-c687-4be7-8c01-6b5a62c63a29 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:37:03.970124 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0fa9777b-c687-4be7-8c01-6b5a62c63a29 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/a3051ffe-ff68-4737-9838-12cb61b509a8" status: 200 len: 1680 microversion: 2.1 time: 0.152059 Jun 16 12:37:03.970696 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 497/1003] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:37:03 2022] GET /compute/v2.1/servers/a3051ffe-ff68-4737-9838-12cb61b509a8 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:37:04.992772 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a3de753d-539c-4e8d-bd83-2c04359bc0d0 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:37:04.993969 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a3de753d-539c-4e8d-bd83-2c04359bc0d0 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: a3051ffe-ff68-4737-9838-12cb61b509a8] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:37:05.000897 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a3de753d-539c-4e8d-bd83-2c04359bc0d0 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:05.001341 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a3de753d-539c-4e8d-bd83-2c04359bc0d0 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:05.002148 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a3de753d-539c-4e8d-bd83-2c04359bc0d0 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:05.002582 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a3de753d-539c-4e8d-bd83-2c04359bc0d0 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:05.128899 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a3de753d-539c-4e8d-bd83-2c04359bc0d0 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:37:05.136306 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a3de753d-539c-4e8d-bd83-2c04359bc0d0 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/a3051ffe-ff68-4737-9838-12cb61b509a8" status: 200 len: 1680 microversion: 2.1 time: 0.152173 Jun 16 12:37:05.136869 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 507/1004] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:37:04 2022] GET /compute/v2.1/servers/a3051ffe-ff68-4737-9838-12cb61b509a8 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:37:06.153114 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2c755543-bbd0-4171-84bd-02a042aac184 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:37:06.153742 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2c755543-bbd0-4171-84bd-02a042aac184 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: a3051ffe-ff68-4737-9838-12cb61b509a8] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:37:06.160354 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2c755543-bbd0-4171-84bd-02a042aac184 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:06.160809 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2c755543-bbd0-4171-84bd-02a042aac184 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:06.161587 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2c755543-bbd0-4171-84bd-02a042aac184 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:06.162058 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2c755543-bbd0-4171-84bd-02a042aac184 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:06.386831 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2c755543-bbd0-4171-84bd-02a042aac184 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6b630c60d640afb1325215ea27acef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fce886a9a894240a0b3bd3af94d2465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:37:06.394337 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2c755543-bbd0-4171-84bd-02a042aac184 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/a3051ffe-ff68-4737-9838-12cb61b509a8" status: 200 len: 1680 microversion: 2.1 time: 0.245375 Jun 16 12:37:06.394904 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 498/1005] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:37:06 2022] GET /compute/v2.1/servers/a3051ffe-ff68-4737-9838-12cb61b509a8 => generated 1680 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:37:06.809593 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-eb666075-0009-4cf7-b6f3-26b7056d09c5 req-de391126-d75d-4a24-8b93-1fa817752bc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3051ffe-ff68-4737-9838-12cb61b509a8", "name": "network-vif-deleted", "tag": "da76e069-6a47-4f2c-b606-30c8b95c40c7"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:37:06.820883 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-eb666075-0009-4cf7-b6f3-26b7056d09c5 req-de391126-d75d-4a24-8b93-1fa817752bc8 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:06.821952 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-eb666075-0009-4cf7-b6f3-26b7056d09c5 req-de391126-d75d-4a24-8b93-1fa817752bc8 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:06.840227 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-eb666075-0009-4cf7-b6f3-26b7056d09c5 req-de391126-d75d-4a24-8b93-1fa817752bc8 service nova] Creating event network-vif-deleted:da76e069-6a47-4f2c-b606-30c8b95c40c7 for instance a3051ffe-ff68-4737-9838-12cb61b509a8 on hv-cinder-84614 Jun 16 12:37:06.845030 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-eb666075-0009-4cf7-b6f3-26b7056d09c5 req-de391126-d75d-4a24-8b93-1fa817752bc8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039312 Jun 16 12:37:06.846158 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 508/1006] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:37:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:37:07.411553 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-33abfbf1-6212-49ef-a562-a7991f6c1ac4 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:37:07.412163 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-33abfbf1-6212-49ef-a562-a7991f6c1ac4 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: a3051ffe-ff68-4737-9838-12cb61b509a8] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:37:07.418619 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-33abfbf1-6212-49ef-a562-a7991f6c1ac4 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:07.419065 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-33abfbf1-6212-49ef-a562-a7991f6c1ac4 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:07.419854 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-33abfbf1-6212-49ef-a562-a7991f6c1ac4 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:07.420286 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-33abfbf1-6212-49ef-a562-a7991f6c1ac4 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:07.433783 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-33abfbf1-6212-49ef-a562-a7991f6c1ac4 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] HTTP exception thrown: Instance a3051ffe-ff68-4737-9838-12cb61b509a8 could not be found. Jun 16 12:37:07.435471 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-33abfbf1-6212-49ef-a562-a7991f6c1ac4 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Request method failure captured: Jun 16 12:37:07.435471 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: request: GET /compute/v2.1/servers/a3051ffe-ff68-4737-9838-12cb61b509a8 HTTP/1.1 Jun 16 12:37:07.435471 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 16 12:37:07.435471 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 16 12:37:07.435471 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Connection: close Jun 16 12:37:07.435471 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 16 12:37:07.435471 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 16 12:37:07.435471 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Host: 10.222.0.45 Jun 16 12:37:07.435471 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 16 12:37:07.435471 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 16 12:37:07.435471 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABiqyGF1I7NNsn9N-NNLw8e7JwWQfFAz21t9AN_OlEcHKfvG-zVtCE3h0xqQLPiYlGgCbqHJIMx6mphLTjEkYrptZmSsukd0-SUbPj3ipfsUXouJgw4LZCCngD_KxZq-5FKd9EOmAaCBK7p8lhdHrTX3rZ5m9BxXUJmHDIk-Sxu6p9pH_c Jun 16 12:37:07.435471 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 16 12:37:07.435471 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 16 12:37:07.435471 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 16 12:37:07.435471 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 16 12:37:07.435471 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 16 12:37:07.435471 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 16 12:37:07.435471 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Id: 3fce886a9a894240a0b3bd3af94d2465 Jun 16 12:37:07.435471 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-AttachVolumeNegativeTest-1612233326 Jun 16 12:37:07.435471 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 16 12:37:07.435471 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 16 12:37:07.437115 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3fce886a9a894240a0b3bd3af94d2465"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3fce886a9a894240a0b3bd3af94d2465"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3fce886a9a894240a0b3bd3af94d2465"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3fce886a9a894240a0b3bd3af94d2465"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Jun 16 12:37:07.437115 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-AttachVolumeNegativeTest-1612233326 Jun 16 12:37:07.437115 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 3fce886a9a894240a0b3bd3af94d2465 Jun 16 12:37:07.437115 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1612233326 Jun 16 12:37:07.437115 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User: tempest-AttachVolumeNegativeTest-1612233326-project Jun 16 12:37:07.437115 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 16 12:37:07.437115 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 16 12:37:07.437115 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Id: ed6b630c60d640afb1325215ea27acef Jun 16 12:37:07.437115 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-AttachVolumeNegativeTest-1612233326-project Jun 16 12:37:07.437115 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: method: > Jun 16 12:37:07.437115 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: exception: Instance a3051ffe-ff68-4737-9838-12cb61b509a8 could not be found. Jun 16 12:37:07.437115 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: action_args: {'id': 'a3051ffe-ff68-4737-9838-12cb61b509a8'} Jun 16 12:37:07.438111 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:37:07.438111 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:37:07.438111 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:37:07.438111 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:37:07.438111 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:37:07.438111 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:37:07.438111 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:37:07.438111 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:37:07.438111 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:37:07.438111 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:37:07.438111 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3051ffe-ff68-4737-9838-12cb61b509a8 could not be found. Jun 16 12:37:07.438111 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:37:07.438111 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:37:07.438111 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:37:07.438111 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:37:07.438111 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:37:07.438111 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:37:07.438111 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:37:07.438111 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:37:07.438111 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:37:07.439450 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:37:07.439450 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 12:37:07.439450 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 12:37:07.439450 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:37:07.439450 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:37:07.439450 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:37:07.439450 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:37:07.439450 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3051ffe-ff68-4737-9838-12cb61b509a8 could not be found. Jun 16 12:37:07.439450 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:37:07.439450 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:37:07.439450 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:37:07.439450 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:37:07.439450 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:37:07.439450 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:37:07.439450 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:37:07.439450 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:37:07.439450 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3051ffe-ff68-4737-9838-12cb61b509a8 could not be found. Jun 16 12:37:07.439450 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:37:07.440615 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-33abfbf1-6212-49ef-a562-a7991f6c1ac4 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Returning 404 to user: Instance a3051ffe-ff68-4737-9838-12cb61b509a8 could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:37:07.440615 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-33abfbf1-6212-49ef-a562-a7991f6c1ac4 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/a3051ffe-ff68-4737-9838-12cb61b509a8" status: 404 len: 111 microversion: 2.1 time: 0.029134 Jun 16 12:37:07.440615 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 499/1007] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:37:07 2022] GET /compute/v2.1/servers/a3051ffe-ff68-4737-9838-12cb61b509a8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 12:37:07.446980 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8eba28da-20fd-470c-b00b-0060774fc793 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '.version_select at 0x7f7c72131af0>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:37:07.450420 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8eba28da-20fd-470c-b00b-0060774fc793 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [5719d4f7-d268-4d74-861c-75abc55cd690] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 16 12:37:08.457278 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO oslo.messaging._drivers.impl_rabbit [None req-8eba28da-20fd-470c-b00b-0060774fc793 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [5719d4f7-d268-4d74-861c-75abc55cd690] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 43956. Jun 16 12:37:08.475065 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8eba28da-20fd-470c-b00b-0060774fc793 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-806194570" status: 202 len: 0 microversion: 2.1 time: 1.033015 Jun 16 12:37:08.475790 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 509/1008] 10.222.0.45 () {58 vars in 1217 bytes} [Thu Jun 16 12:37:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-806194570 => generated 0 bytes in 1034 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 12:37:08.729403 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-dbb2c443-bbac-407b-97b3-841f870eaa68 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:37:08.730367 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-dbb2c443-bbac-407b-97b3-841f870eaa68 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:37:08.736824 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dbb2c443-bbac-407b-97b3-841f870eaa68 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:08.737368 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dbb2c443-bbac-407b-97b3-841f870eaa68 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:08.738232 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dbb2c443-bbac-407b-97b3-841f870eaa68 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:08.738734 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dbb2c443-bbac-407b-97b3-841f870eaa68 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:08.768182 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-dbb2c443-bbac-407b-97b3-841f870eaa68 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043468 Jun 16 12:37:08.768730 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 500/1009] 10.222.0.45 () {60 vars in 1342 bytes} [Thu Jun 16 12:37:08 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:37:08.828353 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d7647e03-3279-4a89-a41a-da85874e093d tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:37:08.829010 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d7647e03-3279-4a89-a41a-da85874e093d tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:37:08.836626 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d7647e03-3279-4a89-a41a-da85874e093d tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:08.837073 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d7647e03-3279-4a89-a41a-da85874e093d tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:08.837847 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d7647e03-3279-4a89-a41a-da85874e093d tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:08.838317 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d7647e03-3279-4a89-a41a-da85874e093d tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:08.864590 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d7647e03-3279-4a89-a41a-da85874e093d tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Going to try to terminate instance {{(pid=117607) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 12:37:08.941631 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d7647e03-3279-4a89-a41a-da85874e093d tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "DELETE /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 204 len: 0 microversion: 2.20 time: 0.116931 Jun 16 12:37:08.946503 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 510/1010] 10.222.0.45 () {60 vars in 1279 bytes} [Thu Jun 16 12:37:08 2022] DELETE /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 12:37:08.952696 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-968fcd2b-5345-401f-b3d8-ea887e403861 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:37:08.953306 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-968fcd2b-5345-401f-b3d8-ea887e403861 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:37:08.959300 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-968fcd2b-5345-401f-b3d8-ea887e403861 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:08.959800 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-968fcd2b-5345-401f-b3d8-ea887e403861 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:08.961235 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-968fcd2b-5345-401f-b3d8-ea887e403861 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:08.961663 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-968fcd2b-5345-401f-b3d8-ea887e403861 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:09.163061 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-968fcd2b-5345-401f-b3d8-ea887e403861 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:37:09.171169 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-968fcd2b-5345-401f-b3d8-ea887e403861 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:37:09.172706 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-968fcd2b-5345-401f-b3d8-ea887e403861 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:37:09.173918 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-968fcd2b-5345-401f-b3d8-ea887e403861 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 200 len: 1723 microversion: 2.20 time: 0.225620 Jun 16 12:37:09.174471 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 501/1011] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:37:08 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 1723 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:37:10.195183 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3ecbd84e-867d-476d-8f62-1ae8120bd3f9 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:37:10.195880 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3ecbd84e-867d-476d-8f62-1ae8120bd3f9 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:37:10.202287 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3ecbd84e-867d-476d-8f62-1ae8120bd3f9 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:10.202730 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3ecbd84e-867d-476d-8f62-1ae8120bd3f9 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:10.203491 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3ecbd84e-867d-476d-8f62-1ae8120bd3f9 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:10.203925 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3ecbd84e-867d-476d-8f62-1ae8120bd3f9 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:10.283193 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-70f3d6ec-eb33-45f4-8911-6fe239aacd5b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:37:10.283701 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-70f3d6ec-eb33-45f4-8911-6fe239aacd5b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: a3051ffe-ff68-4737-9838-12cb61b509a8] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:37:10.291978 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-70f3d6ec-eb33-45f4-8911-6fe239aacd5b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:10.292441 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-70f3d6ec-eb33-45f4-8911-6fe239aacd5b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:10.293217 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-70f3d6ec-eb33-45f4-8911-6fe239aacd5b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:10.293662 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-70f3d6ec-eb33-45f4-8911-6fe239aacd5b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:10.307810 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-70f3d6ec-eb33-45f4-8911-6fe239aacd5b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] HTTP exception thrown: Instance a3051ffe-ff68-4737-9838-12cb61b509a8 could not be found. Jun 16 12:37:10.309364 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-70f3d6ec-eb33-45f4-8911-6fe239aacd5b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Request method failure captured: Jun 16 12:37:10.309364 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: request: DELETE /compute/v2.1/servers/a3051ffe-ff68-4737-9838-12cb61b509a8 HTTP/1.1 Jun 16 12:37:10.309364 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 16 12:37:10.309364 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 16 12:37:10.309364 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Connection: close Jun 16 12:37:10.309364 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 16 12:37:10.309364 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 16 12:37:10.309364 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Host: 10.222.0.45 Jun 16 12:37:10.309364 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 16 12:37:10.309364 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 16 12:37:10.309364 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABiqyGF1I7NNsn9N-NNLw8e7JwWQfFAz21t9AN_OlEcHKfvG-zVtCE3h0xqQLPiYlGgCbqHJIMx6mphLTjEkYrptZmSsukd0-SUbPj3ipfsUXouJgw4LZCCngD_KxZq-5FKd9EOmAaCBK7p8lhdHrTX3rZ5m9BxXUJmHDIk-Sxu6p9pH_c Jun 16 12:37:10.309364 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 16 12:37:10.309364 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 16 12:37:10.309364 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 16 12:37:10.309364 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 16 12:37:10.309364 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 16 12:37:10.309364 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 16 12:37:10.309364 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Id: 3fce886a9a894240a0b3bd3af94d2465 Jun 16 12:37:10.309364 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-AttachVolumeNegativeTest-1612233326 Jun 16 12:37:10.309364 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 16 12:37:10.309364 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 16 12:37:10.311173 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3fce886a9a894240a0b3bd3af94d2465"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3fce886a9a894240a0b3bd3af94d2465"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3fce886a9a894240a0b3bd3af94d2465"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3fce886a9a894240a0b3bd3af94d2465"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Jun 16 12:37:10.311173 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-AttachVolumeNegativeTest-1612233326 Jun 16 12:37:10.311173 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 3fce886a9a894240a0b3bd3af94d2465 Jun 16 12:37:10.311173 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1612233326 Jun 16 12:37:10.311173 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User: tempest-AttachVolumeNegativeTest-1612233326-project Jun 16 12:37:10.311173 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 16 12:37:10.311173 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 16 12:37:10.311173 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Id: ed6b630c60d640afb1325215ea27acef Jun 16 12:37:10.311173 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-AttachVolumeNegativeTest-1612233326-project Jun 16 12:37:10.311173 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: method: > Jun 16 12:37:10.311173 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: exception: Instance a3051ffe-ff68-4737-9838-12cb61b509a8 could not be found. Jun 16 12:37:10.311173 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: action_args: {'id': 'a3051ffe-ff68-4737-9838-12cb61b509a8'} Jun 16 12:37:10.312038 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:37:10.312038 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:37:10.312038 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:37:10.312038 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:37:10.312038 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:37:10.312038 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:37:10.312038 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:37:10.312038 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:37:10.312038 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:37:10.312038 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:37:10.312038 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3051ffe-ff68-4737-9838-12cb61b509a8 could not be found. Jun 16 12:37:10.312038 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:37:10.312038 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:37:10.312038 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:37:10.312038 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:37:10.312038 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:37:10.312038 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:37:10.312038 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:37:10.312038 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:37:10.312038 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:37:10.313383 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:37:10.313383 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 12:37:10.313383 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 12:37:10.313383 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 12:37:10.313383 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 12:37:10.313383 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:37:10.313383 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:37:10.313383 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:37:10.313383 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:37:10.313383 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3051ffe-ff68-4737-9838-12cb61b509a8 could not be found. Jun 16 12:37:10.313383 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:37:10.313383 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:37:10.313383 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:37:10.313383 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:37:10.313383 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:37:10.313383 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:37:10.313383 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:37:10.313383 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:37:10.313383 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3051ffe-ff68-4737-9838-12cb61b509a8 could not be found. Jun 16 12:37:10.313383 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:37:10.315866 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-70f3d6ec-eb33-45f4-8911-6fe239aacd5b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Returning 404 to user: Instance a3051ffe-ff68-4737-9838-12cb61b509a8 could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:37:10.315866 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-70f3d6ec-eb33-45f4-8911-6fe239aacd5b tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "DELETE /compute/v2.1/servers/a3051ffe-ff68-4737-9838-12cb61b509a8" status: 404 len: 111 microversion: 2.1 time: 0.031384 Jun 16 12:37:10.315866 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 502/1012] 10.222.0.45 () {58 vars in 1238 bytes} [Thu Jun 16 12:37:10 2022] DELETE /compute/v2.1/servers/a3051ffe-ff68-4737-9838-12cb61b509a8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 12:37:10.318706 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9e9823cc-9236-4f59-bc17-303e83e63e66 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:37:10.319810 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9e9823cc-9236-4f59-bc17-303e83e63e66 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: a3051ffe-ff68-4737-9838-12cb61b509a8] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:37:10.325628 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9e9823cc-9236-4f59-bc17-303e83e63e66 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:10.326112 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9e9823cc-9236-4f59-bc17-303e83e63e66 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:10.326892 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9e9823cc-9236-4f59-bc17-303e83e63e66 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:10.327333 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9e9823cc-9236-4f59-bc17-303e83e63e66 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:10.338553 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-3ecbd84e-867d-476d-8f62-1ae8120bd3f9 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:37:10.341617 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-9e9823cc-9236-4f59-bc17-303e83e63e66 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] HTTP exception thrown: Instance a3051ffe-ff68-4737-9838-12cb61b509a8 could not be found. Jun 16 12:37:10.343172 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9e9823cc-9236-4f59-bc17-303e83e63e66 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Request method failure captured: Jun 16 12:37:10.343172 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: request: GET /compute/v2.1/servers/a3051ffe-ff68-4737-9838-12cb61b509a8 HTTP/1.1 Jun 16 12:37:10.343172 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 16 12:37:10.343172 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 16 12:37:10.343172 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Connection: close Jun 16 12:37:10.343172 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 16 12:37:10.343172 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 16 12:37:10.343172 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Host: 10.222.0.45 Jun 16 12:37:10.343172 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 16 12:37:10.343172 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 16 12:37:10.343172 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABiqyGF1I7NNsn9N-NNLw8e7JwWQfFAz21t9AN_OlEcHKfvG-zVtCE3h0xqQLPiYlGgCbqHJIMx6mphLTjEkYrptZmSsukd0-SUbPj3ipfsUXouJgw4LZCCngD_KxZq-5FKd9EOmAaCBK7p8lhdHrTX3rZ5m9BxXUJmHDIk-Sxu6p9pH_c Jun 16 12:37:10.343172 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 16 12:37:10.343172 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 16 12:37:10.343172 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 16 12:37:10.343172 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 16 12:37:10.343172 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 16 12:37:10.343172 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 16 12:37:10.343172 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Id: 3fce886a9a894240a0b3bd3af94d2465 Jun 16 12:37:10.343172 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-AttachVolumeNegativeTest-1612233326 Jun 16 12:37:10.343172 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 16 12:37:10.343172 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 16 12:37:10.344697 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3fce886a9a894240a0b3bd3af94d2465"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3fce886a9a894240a0b3bd3af94d2465"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3fce886a9a894240a0b3bd3af94d2465"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3fce886a9a894240a0b3bd3af94d2465"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Jun 16 12:37:10.344697 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-AttachVolumeNegativeTest-1612233326 Jun 16 12:37:10.344697 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 3fce886a9a894240a0b3bd3af94d2465 Jun 16 12:37:10.344697 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1612233326 Jun 16 12:37:10.344697 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User: tempest-AttachVolumeNegativeTest-1612233326-project Jun 16 12:37:10.344697 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 16 12:37:10.344697 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 16 12:37:10.344697 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Id: ed6b630c60d640afb1325215ea27acef Jun 16 12:37:10.344697 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-AttachVolumeNegativeTest-1612233326-project Jun 16 12:37:10.344697 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: method: > Jun 16 12:37:10.344697 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: exception: Instance a3051ffe-ff68-4737-9838-12cb61b509a8 could not be found. Jun 16 12:37:10.344697 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: action_args: {'id': 'a3051ffe-ff68-4737-9838-12cb61b509a8'} Jun 16 12:37:10.345550 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:37:10.345550 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:37:10.345550 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:37:10.345550 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:37:10.345550 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:37:10.345550 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:37:10.345550 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:37:10.345550 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:37:10.345550 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:37:10.345550 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:37:10.345550 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3051ffe-ff68-4737-9838-12cb61b509a8 could not be found. Jun 16 12:37:10.345550 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:37:10.345550 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:37:10.345550 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:37:10.345550 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:37:10.345550 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:37:10.345550 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:37:10.345550 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:37:10.345550 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:37:10.345550 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:37:10.346993 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:37:10.346993 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 12:37:10.346993 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 12:37:10.346993 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:37:10.346993 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:37:10.346993 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:37:10.346993 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:37:10.346993 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3051ffe-ff68-4737-9838-12cb61b509a8 could not be found. Jun 16 12:37:10.346993 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:37:10.346993 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:37:10.346993 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:37:10.346993 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:37:10.346993 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:37:10.346993 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:37:10.346993 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:37:10.346993 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:37:10.346993 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3051ffe-ff68-4737-9838-12cb61b509a8 could not be found. Jun 16 12:37:10.346993 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:37:10.348218 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9e9823cc-9236-4f59-bc17-303e83e63e66 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Returning 404 to user: Instance a3051ffe-ff68-4737-9838-12cb61b509a8 could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:37:10.348218 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9e9823cc-9236-4f59-bc17-303e83e63e66 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/a3051ffe-ff68-4737-9838-12cb61b509a8" status: 404 len: 111 microversion: 2.1 time: 0.029360 Jun 16 12:37:10.348218 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 503/1013] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:37:10 2022] GET /compute/v2.1/servers/a3051ffe-ff68-4737-9838-12cb61b509a8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 12:37:10.350707 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-3ecbd84e-867d-476d-8f62-1ae8120bd3f9 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:37:10.352425 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-3ecbd84e-867d-476d-8f62-1ae8120bd3f9 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:37:10.353611 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3ecbd84e-867d-476d-8f62-1ae8120bd3f9 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 200 len: 1723 microversion: 2.20 time: 0.162934 Jun 16 12:37:10.354385 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 511/1014] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:37:10 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:37:11.373456 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ffe94547-ab5e-45e5-ac03-7dea1d52fee0 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:37:11.374456 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ffe94547-ab5e-45e5-ac03-7dea1d52fee0 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:37:11.381049 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ffe94547-ab5e-45e5-ac03-7dea1d52fee0 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:11.382647 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ffe94547-ab5e-45e5-ac03-7dea1d52fee0 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:11.383575 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ffe94547-ab5e-45e5-ac03-7dea1d52fee0 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:11.384130 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ffe94547-ab5e-45e5-ac03-7dea1d52fee0 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:11.424134 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-b09db8bd-8c71-4b73-98be-791270e18eb1 req-012b9da9-230e-484c-a39d-509cc45db2d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f50c08e9-d310-424a-972c-1c16733a796e", "name": "network-vif-deleted", "tag": "54891bff-8bc6-48af-8125-5099eafe66f7"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:37:11.433789 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-b09db8bd-8c71-4b73-98be-791270e18eb1 req-012b9da9-230e-484c-a39d-509cc45db2d7 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:11.434254 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-b09db8bd-8c71-4b73-98be-791270e18eb1 req-012b9da9-230e-484c-a39d-509cc45db2d7 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:11.447038 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-b09db8bd-8c71-4b73-98be-791270e18eb1 req-012b9da9-230e-484c-a39d-509cc45db2d7 service nova] Creating event network-vif-deleted:54891bff-8bc6-48af-8125-5099eafe66f7 for instance f50c08e9-d310-424a-972c-1c16733a796e on hv-cinder-84614 Jun 16 12:37:11.452586 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-b09db8bd-8c71-4b73-98be-791270e18eb1 req-012b9da9-230e-484c-a39d-509cc45db2d7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032045 Jun 16 12:37:11.453903 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 512/1015] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:37:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 12:37:11.465336 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ffe94547-ab5e-45e5-ac03-7dea1d52fee0 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:37:11.475794 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ffe94547-ab5e-45e5-ac03-7dea1d52fee0 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:37:11.477960 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ffe94547-ab5e-45e5-ac03-7dea1d52fee0 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb370edc0f094c04904eb093a9eb0a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501ea87534094acaa1b0a50b01901cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:37:11.479660 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ffe94547-ab5e-45e5-ac03-7dea1d52fee0 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 200 len: 1655 microversion: 2.20 time: 0.109618 Jun 16 12:37:11.480434 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 504/1016] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:37:11 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 1655 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 12:37:11.503416 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-62c79987-fbc5-424f-8480-ff9268b30b6d tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:37:11.504034 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-62c79987-fbc5-424f-8480-ff9268b30b6d tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9fe7b62b-623e-46c4-9b2d-2c744c2b3512] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:37:11.516016 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-62c79987-fbc5-424f-8480-ff9268b30b6d tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:11.516680 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-62c79987-fbc5-424f-8480-ff9268b30b6d tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:11.519153 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-62c79987-fbc5-424f-8480-ff9268b30b6d tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:11.519782 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-62c79987-fbc5-424f-8480-ff9268b30b6d tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:11.540520 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-62c79987-fbc5-424f-8480-ff9268b30b6d tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] HTTP exception thrown: Instance 9fe7b62b-623e-46c4-9b2d-2c744c2b3512 could not be found. Jun 16 12:37:11.542757 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-62c79987-fbc5-424f-8480-ff9268b30b6d tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Request method failure captured: Jun 16 12:37:11.542757 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: request: DELETE /compute/v2.1/servers/9fe7b62b-623e-46c4-9b2d-2c744c2b3512 HTTP/1.1 Jun 16 12:37:11.542757 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Accept: application/json Jun 16 12:37:11.542757 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jun 16 12:37:11.542757 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Connection: close Jun 16 12:37:11.542757 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jun 16 12:37:11.542757 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jun 16 12:37:11.542757 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Host: 10.222.0.45 Jun 16 12:37:11.542757 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jun 16 12:37:11.542757 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jun 16 12:37:11.542757 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABiqyGF1I7NNsn9N-NNLw8e7JwWQfFAz21t9AN_OlEcHKfvG-zVtCE3h0xqQLPiYlGgCbqHJIMx6mphLTjEkYrptZmSsukd0-SUbPj3ipfsUXouJgw4LZCCngD_KxZq-5FKd9EOmAaCBK7p8lhdHrTX3rZ5m9BxXUJmHDIk-Sxu6p9pH_c Jun 16 12:37:11.542757 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jun 16 12:37:11.542757 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jun 16 12:37:11.542757 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jun 16 12:37:11.542757 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jun 16 12:37:11.542757 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jun 16 12:37:11.542757 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jun 16 12:37:11.542757 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Id: 3fce886a9a894240a0b3bd3af94d2465 Jun 16 12:37:11.542757 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-AttachVolumeNegativeTest-1612233326 Jun 16 12:37:11.542757 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Role: member,reader Jun 16 12:37:11.542757 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Roles: member,reader Jun 16 12:37:11.544187 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3fce886a9a894240a0b3bd3af94d2465"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3fce886a9a894240a0b3bd3af94d2465"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3fce886a9a894240a0b3bd3af94d2465"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3fce886a9a894240a0b3bd3af94d2465"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Jun 16 12:37:11.544187 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-AttachVolumeNegativeTest-1612233326 Jun 16 12:37:11.544187 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant-Id: 3fce886a9a894240a0b3bd3af94d2465 Jun 16 12:37:11.544187 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1612233326 Jun 16 12:37:11.544187 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User: tempest-AttachVolumeNegativeTest-1612233326-project Jun 16 12:37:11.544187 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jun 16 12:37:11.544187 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jun 16 12:37:11.544187 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Id: ed6b630c60d640afb1325215ea27acef Jun 16 12:37:11.544187 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-AttachVolumeNegativeTest-1612233326-project Jun 16 12:37:11.544187 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: method: > Jun 16 12:37:11.544187 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: exception: Instance 9fe7b62b-623e-46c4-9b2d-2c744c2b3512 could not be found. Jun 16 12:37:11.544187 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: action_args: {'id': '9fe7b62b-623e-46c4-9b2d-2c744c2b3512'} Jun 16 12:37:11.544942 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:37:11.544942 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:37:11.544942 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:37:11.544942 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:37:11.544942 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:37:11.544942 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:37:11.544942 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:37:11.544942 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:37:11.544942 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:37:11.544942 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:37:11.544942 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fe7b62b-623e-46c4-9b2d-2c744c2b3512 could not be found. Jun 16 12:37:11.544942 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:37:11.544942 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:37:11.544942 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:37:11.544942 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:37:11.544942 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:37:11.544942 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:37:11.544942 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:37:11.544942 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:37:11.544942 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:37:11.549621 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:37:11.549621 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 12:37:11.549621 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 12:37:11.549621 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 12:37:11.549621 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 12:37:11.549621 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:37:11.549621 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:37:11.549621 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:37:11.549621 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:37:11.549621 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fe7b62b-623e-46c4-9b2d-2c744c2b3512 could not be found. Jun 16 12:37:11.549621 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:37:11.549621 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:37:11.549621 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:37:11.549621 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:37:11.549621 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:37:11.549621 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:37:11.549621 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:37:11.549621 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:37:11.549621 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fe7b62b-623e-46c4-9b2d-2c744c2b3512 could not be found. Jun 16 12:37:11.549621 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:37:11.551146 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-62c79987-fbc5-424f-8480-ff9268b30b6d tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Returning 404 to user: Instance 9fe7b62b-623e-46c4-9b2d-2c744c2b3512 could not be found. {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:37:11.551146 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-62c79987-fbc5-424f-8480-ff9268b30b6d tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "DELETE /compute/v2.1/servers/9fe7b62b-623e-46c4-9b2d-2c744c2b3512" status: 404 len: 111 microversion: 2.1 time: 0.046952 Jun 16 12:37:11.551146 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 513/1017] 10.222.0.45 () {58 vars in 1238 bytes} [Thu Jun 16 12:37:11 2022] DELETE /compute/v2.1/servers/9fe7b62b-623e-46c4-9b2d-2c744c2b3512 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 12:37:11.553155 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d44170fd-f117-4aaa-bd99-ea10d3b24ba0 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:37:11.554055 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d44170fd-f117-4aaa-bd99-ea10d3b24ba0 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9fe7b62b-623e-46c4-9b2d-2c744c2b3512] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:37:11.561542 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d44170fd-f117-4aaa-bd99-ea10d3b24ba0 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:11.562972 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d44170fd-f117-4aaa-bd99-ea10d3b24ba0 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:11.563769 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d44170fd-f117-4aaa-bd99-ea10d3b24ba0 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:11.564217 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d44170fd-f117-4aaa-bd99-ea10d3b24ba0 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:11.580678 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-d44170fd-f117-4aaa-bd99-ea10d3b24ba0 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] HTTP exception thrown: Instance 9fe7b62b-623e-46c4-9b2d-2c744c2b3512 could not be found. Jun 16 12:37:11.582424 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d44170fd-f117-4aaa-bd99-ea10d3b24ba0 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Request method failure captured: Jun 16 12:37:11.582424 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: request: GET /compute/v2.1/servers/9fe7b62b-623e-46c4-9b2d-2c744c2b3512 HTTP/1.1 Jun 16 12:37:11.582424 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 16 12:37:11.582424 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 16 12:37:11.582424 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Connection: close Jun 16 12:37:11.582424 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 16 12:37:11.582424 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 16 12:37:11.582424 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Host: 10.222.0.45 Jun 16 12:37:11.582424 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 16 12:37:11.582424 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 16 12:37:11.582424 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABiqyGF1I7NNsn9N-NNLw8e7JwWQfFAz21t9AN_OlEcHKfvG-zVtCE3h0xqQLPiYlGgCbqHJIMx6mphLTjEkYrptZmSsukd0-SUbPj3ipfsUXouJgw4LZCCngD_KxZq-5FKd9EOmAaCBK7p8lhdHrTX3rZ5m9BxXUJmHDIk-Sxu6p9pH_c Jun 16 12:37:11.582424 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 16 12:37:11.582424 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 16 12:37:11.582424 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 16 12:37:11.582424 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 16 12:37:11.582424 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 16 12:37:11.582424 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 16 12:37:11.582424 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Id: 3fce886a9a894240a0b3bd3af94d2465 Jun 16 12:37:11.582424 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-AttachVolumeNegativeTest-1612233326 Jun 16 12:37:11.582424 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 16 12:37:11.582424 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 16 12:37:11.583760 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3fce886a9a894240a0b3bd3af94d2465"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3fce886a9a894240a0b3bd3af94d2465"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3fce886a9a894240a0b3bd3af94d2465"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3fce886a9a894240a0b3bd3af94d2465"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Jun 16 12:37:11.583760 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-AttachVolumeNegativeTest-1612233326 Jun 16 12:37:11.583760 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 3fce886a9a894240a0b3bd3af94d2465 Jun 16 12:37:11.583760 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1612233326 Jun 16 12:37:11.583760 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User: tempest-AttachVolumeNegativeTest-1612233326-project Jun 16 12:37:11.583760 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 16 12:37:11.583760 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 16 12:37:11.583760 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Id: ed6b630c60d640afb1325215ea27acef Jun 16 12:37:11.583760 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-AttachVolumeNegativeTest-1612233326-project Jun 16 12:37:11.583760 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: method: > Jun 16 12:37:11.583760 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: exception: Instance 9fe7b62b-623e-46c4-9b2d-2c744c2b3512 could not be found. Jun 16 12:37:11.583760 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: action_args: {'id': '9fe7b62b-623e-46c4-9b2d-2c744c2b3512'} Jun 16 12:37:11.584517 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:37:11.584517 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:37:11.584517 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:37:11.584517 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:37:11.584517 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:37:11.584517 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:37:11.584517 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:37:11.584517 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:37:11.584517 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:37:11.584517 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:37:11.584517 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fe7b62b-623e-46c4-9b2d-2c744c2b3512 could not be found. Jun 16 12:37:11.584517 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:37:11.584517 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:37:11.584517 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:37:11.584517 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:37:11.584517 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:37:11.584517 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:37:11.584517 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:37:11.584517 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:37:11.584517 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:37:11.586450 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:37:11.586450 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 12:37:11.586450 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 12:37:11.586450 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:37:11.586450 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:37:11.586450 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:37:11.586450 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:37:11.586450 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fe7b62b-623e-46c4-9b2d-2c744c2b3512 could not be found. Jun 16 12:37:11.586450 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:37:11.586450 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:37:11.586450 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:37:11.586450 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:37:11.586450 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:37:11.586450 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:37:11.586450 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:37:11.586450 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:37:11.586450 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fe7b62b-623e-46c4-9b2d-2c744c2b3512 could not be found. Jun 16 12:37:11.586450 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:37:11.588673 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d44170fd-f117-4aaa-bd99-ea10d3b24ba0 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Returning 404 to user: Instance 9fe7b62b-623e-46c4-9b2d-2c744c2b3512 could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:37:11.588673 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d44170fd-f117-4aaa-bd99-ea10d3b24ba0 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/9fe7b62b-623e-46c4-9b2d-2c744c2b3512" status: 404 len: 111 microversion: 2.1 time: 0.034707 Jun 16 12:37:11.588673 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 505/1018] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:37:11 2022] GET /compute/v2.1/servers/9fe7b62b-623e-46c4-9b2d-2c744c2b3512 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 12:37:11.596346 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-aa04143b-aa9b-41d6-abcf-b19e78080456 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:37:11.596793 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-aa04143b-aa9b-41d6-abcf-b19e78080456 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9abc4b09-7cfc-47dc-b778-684eb2e331b9] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:37:11.604816 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-aa04143b-aa9b-41d6-abcf-b19e78080456 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:11.606975 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-aa04143b-aa9b-41d6-abcf-b19e78080456 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:11.608036 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-aa04143b-aa9b-41d6-abcf-b19e78080456 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:11.608491 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-aa04143b-aa9b-41d6-abcf-b19e78080456 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:11.626814 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-aa04143b-aa9b-41d6-abcf-b19e78080456 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] HTTP exception thrown: Instance 9abc4b09-7cfc-47dc-b778-684eb2e331b9 could not be found. Jun 16 12:37:11.628730 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-aa04143b-aa9b-41d6-abcf-b19e78080456 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Request method failure captured: Jun 16 12:37:11.628730 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: request: DELETE /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9 HTTP/1.1 Jun 16 12:37:11.628730 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Accept: application/json Jun 16 12:37:11.628730 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jun 16 12:37:11.628730 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Connection: close Jun 16 12:37:11.628730 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jun 16 12:37:11.628730 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jun 16 12:37:11.628730 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Host: 10.222.0.45 Jun 16 12:37:11.628730 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jun 16 12:37:11.628730 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jun 16 12:37:11.628730 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABiqyGF1I7NNsn9N-NNLw8e7JwWQfFAz21t9AN_OlEcHKfvG-zVtCE3h0xqQLPiYlGgCbqHJIMx6mphLTjEkYrptZmSsukd0-SUbPj3ipfsUXouJgw4LZCCngD_KxZq-5FKd9EOmAaCBK7p8lhdHrTX3rZ5m9BxXUJmHDIk-Sxu6p9pH_c Jun 16 12:37:11.628730 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jun 16 12:37:11.628730 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jun 16 12:37:11.628730 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jun 16 12:37:11.628730 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jun 16 12:37:11.628730 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jun 16 12:37:11.628730 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jun 16 12:37:11.628730 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Id: 3fce886a9a894240a0b3bd3af94d2465 Jun 16 12:37:11.628730 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-AttachVolumeNegativeTest-1612233326 Jun 16 12:37:11.628730 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Role: member,reader Jun 16 12:37:11.628730 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Roles: member,reader Jun 16 12:37:11.630744 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3fce886a9a894240a0b3bd3af94d2465"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3fce886a9a894240a0b3bd3af94d2465"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3fce886a9a894240a0b3bd3af94d2465"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3fce886a9a894240a0b3bd3af94d2465"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Jun 16 12:37:11.630744 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-AttachVolumeNegativeTest-1612233326 Jun 16 12:37:11.630744 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant-Id: 3fce886a9a894240a0b3bd3af94d2465 Jun 16 12:37:11.630744 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1612233326 Jun 16 12:37:11.630744 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User: tempest-AttachVolumeNegativeTest-1612233326-project Jun 16 12:37:11.630744 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jun 16 12:37:11.630744 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jun 16 12:37:11.630744 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Id: ed6b630c60d640afb1325215ea27acef Jun 16 12:37:11.630744 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-AttachVolumeNegativeTest-1612233326-project Jun 16 12:37:11.630744 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: method: > Jun 16 12:37:11.630744 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: exception: Instance 9abc4b09-7cfc-47dc-b778-684eb2e331b9 could not be found. Jun 16 12:37:11.630744 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: action_args: {'id': '9abc4b09-7cfc-47dc-b778-684eb2e331b9'} Jun 16 12:37:11.632002 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:37:11.632002 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:37:11.632002 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:37:11.632002 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:37:11.632002 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:37:11.632002 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:37:11.632002 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:37:11.632002 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:37:11.632002 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:37:11.632002 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:37:11.632002 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9abc4b09-7cfc-47dc-b778-684eb2e331b9 could not be found. Jun 16 12:37:11.632002 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:37:11.632002 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:37:11.632002 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:37:11.632002 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:37:11.632002 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:37:11.632002 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:37:11.632002 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:37:11.632002 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:37:11.632002 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:37:11.633677 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:37:11.633677 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 12:37:11.633677 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 12:37:11.633677 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 12:37:11.633677 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 12:37:11.633677 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:37:11.633677 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:37:11.633677 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:37:11.633677 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:37:11.633677 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9abc4b09-7cfc-47dc-b778-684eb2e331b9 could not be found. Jun 16 12:37:11.633677 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:37:11.633677 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:37:11.633677 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:37:11.633677 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:37:11.633677 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:37:11.633677 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:37:11.633677 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:37:11.633677 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:37:11.633677 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9abc4b09-7cfc-47dc-b778-684eb2e331b9 could not be found. Jun 16 12:37:11.633677 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:37:11.635270 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-aa04143b-aa9b-41d6-abcf-b19e78080456 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Returning 404 to user: Instance 9abc4b09-7cfc-47dc-b778-684eb2e331b9 could not be found. {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:37:11.635764 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-aa04143b-aa9b-41d6-abcf-b19e78080456 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "DELETE /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9" status: 404 len: 111 microversion: 2.1 time: 0.044861 Jun 16 12:37:11.636557 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 514/1019] 10.222.0.45 () {58 vars in 1238 bytes} [Thu Jun 16 12:37:11 2022] DELETE /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 12:37:11.645621 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-55c5274f-55b6-4af2-a491-ee21864ce155 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:37:11.646263 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-55c5274f-55b6-4af2-a491-ee21864ce155 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: 9abc4b09-7cfc-47dc-b778-684eb2e331b9] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:37:11.655818 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-55c5274f-55b6-4af2-a491-ee21864ce155 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:11.656267 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-55c5274f-55b6-4af2-a491-ee21864ce155 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:11.657041 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-55c5274f-55b6-4af2-a491-ee21864ce155 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:11.657654 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-55c5274f-55b6-4af2-a491-ee21864ce155 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:11.672971 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-55c5274f-55b6-4af2-a491-ee21864ce155 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] HTTP exception thrown: Instance 9abc4b09-7cfc-47dc-b778-684eb2e331b9 could not be found. Jun 16 12:37:11.674829 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-55c5274f-55b6-4af2-a491-ee21864ce155 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Request method failure captured: Jun 16 12:37:11.674829 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: request: GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9 HTTP/1.1 Jun 16 12:37:11.674829 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 16 12:37:11.674829 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 16 12:37:11.674829 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Connection: close Jun 16 12:37:11.674829 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 16 12:37:11.674829 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 16 12:37:11.674829 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Host: 10.222.0.45 Jun 16 12:37:11.674829 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 16 12:37:11.674829 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 16 12:37:11.674829 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABiqyGF1I7NNsn9N-NNLw8e7JwWQfFAz21t9AN_OlEcHKfvG-zVtCE3h0xqQLPiYlGgCbqHJIMx6mphLTjEkYrptZmSsukd0-SUbPj3ipfsUXouJgw4LZCCngD_KxZq-5FKd9EOmAaCBK7p8lhdHrTX3rZ5m9BxXUJmHDIk-Sxu6p9pH_c Jun 16 12:37:11.674829 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 16 12:37:11.674829 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 16 12:37:11.674829 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 16 12:37:11.674829 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 16 12:37:11.674829 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 16 12:37:11.674829 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 16 12:37:11.674829 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Id: 3fce886a9a894240a0b3bd3af94d2465 Jun 16 12:37:11.674829 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-AttachVolumeNegativeTest-1612233326 Jun 16 12:37:11.674829 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 16 12:37:11.674829 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 16 12:37:11.676388 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3fce886a9a894240a0b3bd3af94d2465"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3fce886a9a894240a0b3bd3af94d2465"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3fce886a9a894240a0b3bd3af94d2465"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3fce886a9a894240a0b3bd3af94d2465"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Jun 16 12:37:11.676388 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-AttachVolumeNegativeTest-1612233326 Jun 16 12:37:11.676388 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 3fce886a9a894240a0b3bd3af94d2465 Jun 16 12:37:11.676388 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1612233326 Jun 16 12:37:11.676388 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User: tempest-AttachVolumeNegativeTest-1612233326-project Jun 16 12:37:11.676388 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 16 12:37:11.676388 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 16 12:37:11.676388 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Id: ed6b630c60d640afb1325215ea27acef Jun 16 12:37:11.676388 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-AttachVolumeNegativeTest-1612233326-project Jun 16 12:37:11.676388 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: method: > Jun 16 12:37:11.676388 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: exception: Instance 9abc4b09-7cfc-47dc-b778-684eb2e331b9 could not be found. Jun 16 12:37:11.676388 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: action_args: {'id': '9abc4b09-7cfc-47dc-b778-684eb2e331b9'} Jun 16 12:37:11.677204 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:37:11.677204 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:37:11.677204 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:37:11.677204 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:37:11.677204 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:37:11.677204 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:37:11.677204 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:37:11.677204 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:37:11.677204 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:37:11.677204 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:37:11.677204 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9abc4b09-7cfc-47dc-b778-684eb2e331b9 could not be found. Jun 16 12:37:11.677204 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:37:11.677204 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:37:11.677204 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:37:11.677204 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:37:11.677204 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:37:11.677204 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:37:11.677204 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:37:11.677204 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:37:11.677204 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:37:11.679673 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:37:11.679673 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 12:37:11.679673 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 12:37:11.679673 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:37:11.679673 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:37:11.679673 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:37:11.679673 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:37:11.679673 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9abc4b09-7cfc-47dc-b778-684eb2e331b9 could not be found. Jun 16 12:37:11.679673 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:37:11.679673 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:37:11.679673 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:37:11.679673 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:37:11.679673 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:37:11.679673 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:37:11.679673 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:37:11.679673 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:37:11.679673 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9abc4b09-7cfc-47dc-b778-684eb2e331b9 could not be found. Jun 16 12:37:11.679673 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:37:11.682197 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-55c5274f-55b6-4af2-a491-ee21864ce155 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Returning 404 to user: Instance 9abc4b09-7cfc-47dc-b778-684eb2e331b9 could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:37:11.683063 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-55c5274f-55b6-4af2-a491-ee21864ce155 tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9" status: 404 len: 111 microversion: 2.1 time: 0.042461 Jun 16 12:37:11.683628 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 506/1020] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:37:11 2022] GET /compute/v2.1/servers/9abc4b09-7cfc-47dc-b778-684eb2e331b9 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 12:37:12.498021 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-04f6e81a-bffe-439e-a3d2-5f1280774b3f tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:37:12.498635 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-04f6e81a-bffe-439e-a3d2-5f1280774b3f tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:37:12.505085 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-04f6e81a-bffe-439e-a3d2-5f1280774b3f tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:12.505533 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-04f6e81a-bffe-439e-a3d2-5f1280774b3f tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:12.506311 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-04f6e81a-bffe-439e-a3d2-5f1280774b3f tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:12.507240 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-04f6e81a-bffe-439e-a3d2-5f1280774b3f tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:12.520403 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-04f6e81a-bffe-439e-a3d2-5f1280774b3f tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] HTTP exception thrown: Instance f50c08e9-d310-424a-972c-1c16733a796e could not be found. Jun 16 12:37:12.521928 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-04f6e81a-bffe-439e-a3d2-5f1280774b3f tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Request method failure captured: Jun 16 12:37:12.521928 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: request: GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e HTTP/1.1 Jun 16 12:37:12.521928 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Accept: application/json Jun 16 12:37:12.521928 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jun 16 12:37:12.521928 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Connection: close Jun 16 12:37:12.521928 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jun 16 12:37:12.521928 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jun 16 12:37:12.521928 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Host: 10.222.0.45 Jun 16 12:37:12.521928 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jun 16 12:37:12.521928 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jun 16 12:37:12.521928 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABiqyGF45WJthPoje2fm_CkoZIB6HenyTxmCcWuoWEwLwDmGmYSmBO0DdCi7iivh_AJxLzcemhDXmPR5vvH45qL8qC_XPuYlBrA1x8oGGXWiuPkoeqCyenYIUhaTgwioAG2Eo7jiMG6peQL1gAPmaq76kMQ_e0BLllLSBNLTOsXKFAP7II Jun 16 12:37:12.521928 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jun 16 12:37:12.521928 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jun 16 12:37:12.521928 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jun 16 12:37:12.521928 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jun 16 12:37:12.521928 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 12:37:12.521928 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jun 16 12:37:12.521928 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jun 16 12:37:12.521928 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Id: 501ea87534094acaa1b0a50b01901cac Jun 16 12:37:12.521928 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-551653103 Jun 16 12:37:12.521928 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Role: member,reader Jun 16 12:37:12.521928 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Roles: member,reader Jun 16 12:37:12.524782 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/501ea87534094acaa1b0a50b01901cac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/501ea87534094acaa1b0a50b01901cac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_501ea87534094acaa1b0a50b01901cac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/501ea87534094acaa1b0a50b01901cac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Jun 16 12:37:12.524782 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-AttachVolumeShelveTestJSON-551653103 Jun 16 12:37:12.524782 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant-Id: 501ea87534094acaa1b0a50b01901cac Jun 16 12:37:12.524782 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-551653103 Jun 16 12:37:12.524782 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User: tempest-AttachVolumeShelveTestJSON-551653103-project Jun 16 12:37:12.524782 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jun 16 12:37:12.524782 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jun 16 12:37:12.524782 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Id: cb370edc0f094c04904eb093a9eb0a42 Jun 16 12:37:12.524782 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-AttachVolumeShelveTestJSON-551653103-project Jun 16 12:37:12.524782 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: method: > Jun 16 12:37:12.524782 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: exception: Instance f50c08e9-d310-424a-972c-1c16733a796e could not be found. Jun 16 12:37:12.524782 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: action_args: {'id': 'f50c08e9-d310-424a-972c-1c16733a796e'} Jun 16 12:37:12.525681 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:37:12.525681 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:37:12.525681 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:37:12.525681 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:37:12.525681 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:37:12.525681 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:37:12.525681 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:37:12.525681 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:37:12.525681 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:37:12.525681 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:37:12.525681 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f50c08e9-d310-424a-972c-1c16733a796e could not be found. Jun 16 12:37:12.525681 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:37:12.525681 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:37:12.525681 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:37:12.525681 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:37:12.525681 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:37:12.525681 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:37:12.525681 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:37:12.525681 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:37:12.525681 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:37:12.527424 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:37:12.527424 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 12:37:12.527424 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 12:37:12.527424 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:37:12.527424 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:37:12.527424 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:37:12.527424 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:37:12.527424 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f50c08e9-d310-424a-972c-1c16733a796e could not be found. Jun 16 12:37:12.527424 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:37:12.527424 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:37:12.527424 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:37:12.527424 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:37:12.527424 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:37:12.527424 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:37:12.527424 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:37:12.527424 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:37:12.527424 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f50c08e9-d310-424a-972c-1c16733a796e could not be found. Jun 16 12:37:12.527424 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:37:12.528980 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-04f6e81a-bffe-439e-a3d2-5f1280774b3f tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Returning 404 to user: Instance f50c08e9-d310-424a-972c-1c16733a796e could not be found. {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:37:12.528980 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-04f6e81a-bffe-439e-a3d2-5f1280774b3f tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 404 len: 111 microversion: 2.20 time: 0.029882 Jun 16 12:37:12.528980 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 515/1021] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:37:12 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 12:37:12.532817 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3b8795ad-1d74-4bce-9f65-7463b5341a0b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '.version_select at 0x7f7c720d1040>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:37:12.549497 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3b8795ad-1d74-4bce-9f65-7463b5341a0b tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1271708607" status: 204 len: 0 microversion: 2.20 time: 0.020435 Jun 16 12:37:12.550070 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 507/1022] 10.222.0.45 () {60 vars in 1261 bytes} [Thu Jun 16 12:37:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1271708607 => generated 0 bytes in 22 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 12:37:12.826517 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7dc47d93-446a-4f98-8c8e-f0bb3e8871fa tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:37:12.827013 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7dc47d93-446a-4f98-8c8e-f0bb3e8871fa tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: ddba5ba6-d9f4-493c-b15b-9443a5426682] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:37:12.833104 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7dc47d93-446a-4f98-8c8e-f0bb3e8871fa tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:12.833560 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7dc47d93-446a-4f98-8c8e-f0bb3e8871fa tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:12.834344 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7dc47d93-446a-4f98-8c8e-f0bb3e8871fa tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:12.835369 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7dc47d93-446a-4f98-8c8e-f0bb3e8871fa tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:12.848634 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-7dc47d93-446a-4f98-8c8e-f0bb3e8871fa tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] HTTP exception thrown: Instance ddba5ba6-d9f4-493c-b15b-9443a5426682 could not be found. Jun 16 12:37:12.850291 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7dc47d93-446a-4f98-8c8e-f0bb3e8871fa tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Request method failure captured: Jun 16 12:37:12.850291 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: request: DELETE /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682 HTTP/1.1 Jun 16 12:37:12.850291 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Accept: application/json Jun 16 12:37:12.850291 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jun 16 12:37:12.850291 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Connection: close Jun 16 12:37:12.850291 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jun 16 12:37:12.850291 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jun 16 12:37:12.850291 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Host: 10.222.0.45 Jun 16 12:37:12.850291 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jun 16 12:37:12.850291 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jun 16 12:37:12.850291 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABiqyGF1I7NNsn9N-NNLw8e7JwWQfFAz21t9AN_OlEcHKfvG-zVtCE3h0xqQLPiYlGgCbqHJIMx6mphLTjEkYrptZmSsukd0-SUbPj3ipfsUXouJgw4LZCCngD_KxZq-5FKd9EOmAaCBK7p8lhdHrTX3rZ5m9BxXUJmHDIk-Sxu6p9pH_c Jun 16 12:37:12.850291 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jun 16 12:37:12.850291 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jun 16 12:37:12.850291 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jun 16 12:37:12.850291 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jun 16 12:37:12.850291 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jun 16 12:37:12.850291 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jun 16 12:37:12.850291 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Id: 3fce886a9a894240a0b3bd3af94d2465 Jun 16 12:37:12.850291 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-AttachVolumeNegativeTest-1612233326 Jun 16 12:37:12.850291 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Role: member,reader Jun 16 12:37:12.850291 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Roles: member,reader Jun 16 12:37:12.852336 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3fce886a9a894240a0b3bd3af94d2465"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3fce886a9a894240a0b3bd3af94d2465"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3fce886a9a894240a0b3bd3af94d2465"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3fce886a9a894240a0b3bd3af94d2465"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Jun 16 12:37:12.852336 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-AttachVolumeNegativeTest-1612233326 Jun 16 12:37:12.852336 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant-Id: 3fce886a9a894240a0b3bd3af94d2465 Jun 16 12:37:12.852336 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1612233326 Jun 16 12:37:12.852336 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User: tempest-AttachVolumeNegativeTest-1612233326-project Jun 16 12:37:12.852336 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jun 16 12:37:12.852336 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jun 16 12:37:12.852336 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Id: ed6b630c60d640afb1325215ea27acef Jun 16 12:37:12.852336 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-AttachVolumeNegativeTest-1612233326-project Jun 16 12:37:12.852336 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: method: > Jun 16 12:37:12.852336 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: exception: Instance ddba5ba6-d9f4-493c-b15b-9443a5426682 could not be found. Jun 16 12:37:12.852336 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: action_args: {'id': 'ddba5ba6-d9f4-493c-b15b-9443a5426682'} Jun 16 12:37:12.853248 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:37:12.853248 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:37:12.853248 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:37:12.853248 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:37:12.853248 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:37:12.853248 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:37:12.853248 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:37:12.853248 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:37:12.853248 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:37:12.853248 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:37:12.853248 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddba5ba6-d9f4-493c-b15b-9443a5426682 could not be found. Jun 16 12:37:12.853248 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:37:12.853248 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:37:12.853248 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:37:12.853248 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:37:12.853248 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:37:12.853248 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:37:12.853248 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:37:12.853248 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:37:12.853248 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:37:12.854751 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:37:12.854751 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 12:37:12.854751 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 12:37:12.854751 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 12:37:12.854751 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 12:37:12.854751 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:37:12.854751 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:37:12.854751 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:37:12.854751 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:37:12.854751 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddba5ba6-d9f4-493c-b15b-9443a5426682 could not be found. Jun 16 12:37:12.854751 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:37:12.854751 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:37:12.854751 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:37:12.854751 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:37:12.854751 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:37:12.854751 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:37:12.854751 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:37:12.854751 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:37:12.854751 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddba5ba6-d9f4-493c-b15b-9443a5426682 could not be found. Jun 16 12:37:12.854751 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:37:12.856144 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7dc47d93-446a-4f98-8c8e-f0bb3e8871fa tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Returning 404 to user: Instance ddba5ba6-d9f4-493c-b15b-9443a5426682 could not be found. {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:37:12.856144 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7dc47d93-446a-4f98-8c8e-f0bb3e8871fa tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "DELETE /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682" status: 404 len: 111 microversion: 2.1 time: 0.032542 Jun 16 12:37:12.856144 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 516/1023] 10.222.0.45 () {58 vars in 1238 bytes} [Thu Jun 16 12:37:12 2022] DELETE /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 12:37:12.865168 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8fedd942-40ee-4eea-989a-0870b78091db tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:37:12.866005 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8fedd942-40ee-4eea-989a-0870b78091db tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] [instance: ddba5ba6-d9f4-493c-b15b-9443a5426682] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:37:12.873699 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8fedd942-40ee-4eea-989a-0870b78091db tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:12.874173 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8fedd942-40ee-4eea-989a-0870b78091db tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:12.874927 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8fedd942-40ee-4eea-989a-0870b78091db tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:12.875361 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8fedd942-40ee-4eea-989a-0870b78091db tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:12.888983 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-8fedd942-40ee-4eea-989a-0870b78091db tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] HTTP exception thrown: Instance ddba5ba6-d9f4-493c-b15b-9443a5426682 could not be found. Jun 16 12:37:12.890859 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8fedd942-40ee-4eea-989a-0870b78091db tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Request method failure captured: Jun 16 12:37:12.890859 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: request: GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682 HTTP/1.1 Jun 16 12:37:12.890859 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 16 12:37:12.890859 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 16 12:37:12.890859 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Connection: close Jun 16 12:37:12.890859 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 16 12:37:12.890859 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 16 12:37:12.890859 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Host: 10.222.0.45 Jun 16 12:37:12.890859 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 16 12:37:12.890859 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 16 12:37:12.890859 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABiqyGF1I7NNsn9N-NNLw8e7JwWQfFAz21t9AN_OlEcHKfvG-zVtCE3h0xqQLPiYlGgCbqHJIMx6mphLTjEkYrptZmSsukd0-SUbPj3ipfsUXouJgw4LZCCngD_KxZq-5FKd9EOmAaCBK7p8lhdHrTX3rZ5m9BxXUJmHDIk-Sxu6p9pH_c Jun 16 12:37:12.890859 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 16 12:37:12.890859 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 16 12:37:12.890859 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 16 12:37:12.890859 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 16 12:37:12.890859 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 16 12:37:12.890859 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 16 12:37:12.890859 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Id: 3fce886a9a894240a0b3bd3af94d2465 Jun 16 12:37:12.890859 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-AttachVolumeNegativeTest-1612233326 Jun 16 12:37:12.890859 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 16 12:37:12.890859 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 16 12:37:12.894249 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3fce886a9a894240a0b3bd3af94d2465"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3fce886a9a894240a0b3bd3af94d2465"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3fce886a9a894240a0b3bd3af94d2465"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3fce886a9a894240a0b3bd3af94d2465"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Jun 16 12:37:12.894249 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-AttachVolumeNegativeTest-1612233326 Jun 16 12:37:12.894249 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 3fce886a9a894240a0b3bd3af94d2465 Jun 16 12:37:12.894249 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1612233326 Jun 16 12:37:12.894249 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User: tempest-AttachVolumeNegativeTest-1612233326-project Jun 16 12:37:12.894249 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 16 12:37:12.894249 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 16 12:37:12.894249 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Id: ed6b630c60d640afb1325215ea27acef Jun 16 12:37:12.894249 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-AttachVolumeNegativeTest-1612233326-project Jun 16 12:37:12.894249 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: method: > Jun 16 12:37:12.894249 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: exception: Instance ddba5ba6-d9f4-493c-b15b-9443a5426682 could not be found. Jun 16 12:37:12.894249 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: action_args: {'id': 'ddba5ba6-d9f4-493c-b15b-9443a5426682'} Jun 16 12:37:12.895659 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:37:12.895659 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:37:12.895659 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:37:12.895659 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:37:12.895659 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:37:12.895659 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:37:12.895659 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:37:12.895659 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:37:12.895659 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:37:12.895659 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:37:12.895659 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddba5ba6-d9f4-493c-b15b-9443a5426682 could not be found. Jun 16 12:37:12.895659 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:37:12.895659 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:37:12.895659 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:37:12.895659 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:37:12.895659 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:37:12.895659 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:37:12.895659 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:37:12.895659 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:37:12.895659 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:37:12.898462 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:37:12.898462 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 12:37:12.898462 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 12:37:12.898462 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:37:12.898462 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:37:12.898462 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:37:12.898462 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:37:12.898462 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddba5ba6-d9f4-493c-b15b-9443a5426682 could not be found. Jun 16 12:37:12.898462 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:37:12.898462 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:37:12.898462 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:37:12.898462 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:37:12.898462 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:37:12.898462 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:37:12.898462 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:37:12.898462 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:37:12.898462 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddba5ba6-d9f4-493c-b15b-9443a5426682 could not be found. Jun 16 12:37:12.898462 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:37:12.900411 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8fedd942-40ee-4eea-989a-0870b78091db tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] Returning 404 to user: Instance ddba5ba6-d9f4-493c-b15b-9443a5426682 could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:37:12.900411 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8fedd942-40ee-4eea-989a-0870b78091db tempest-AttachVolumeNegativeTest-1612233326 tempest-AttachVolumeNegativeTest-1612233326-project] 10.222.0.45 "GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682" status: 404 len: 111 microversion: 2.1 time: 0.031609 Jun 16 12:37:12.900411 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 508/1024] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:37:12 2022] GET /compute/v2.1/servers/ddba5ba6-d9f4-493c-b15b-9443a5426682 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 12:37:14.314117 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-bf74f8f1-c573-42e3-833f-8120e75e1163 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:37:14.314614 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-bf74f8f1-c573-42e3-833f-8120e75e1163 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:37:14.322150 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bf74f8f1-c573-42e3-833f-8120e75e1163 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:14.322602 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bf74f8f1-c573-42e3-833f-8120e75e1163 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:14.323376 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bf74f8f1-c573-42e3-833f-8120e75e1163 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:14.323816 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bf74f8f1-c573-42e3-833f-8120e75e1163 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:14.338767 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-bf74f8f1-c573-42e3-833f-8120e75e1163 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] HTTP exception thrown: Instance f50c08e9-d310-424a-972c-1c16733a796e could not be found. Jun 16 12:37:14.340577 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-bf74f8f1-c573-42e3-833f-8120e75e1163 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Request method failure captured: Jun 16 12:37:14.340577 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: request: DELETE /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e HTTP/1.1 Jun 16 12:37:14.340577 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Accept: application/json Jun 16 12:37:14.340577 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jun 16 12:37:14.340577 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Connection: close Jun 16 12:37:14.340577 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jun 16 12:37:14.340577 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jun 16 12:37:14.340577 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Host: 10.222.0.45 Jun 16 12:37:14.340577 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jun 16 12:37:14.340577 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jun 16 12:37:14.340577 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABiqyGF45WJthPoje2fm_CkoZIB6HenyTxmCcWuoWEwLwDmGmYSmBO0DdCi7iivh_AJxLzcemhDXmPR5vvH45qL8qC_XPuYlBrA1x8oGGXWiuPkoeqCyenYIUhaTgwioAG2Eo7jiMG6peQL1gAPmaq76kMQ_e0BLllLSBNLTOsXKFAP7II Jun 16 12:37:14.340577 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jun 16 12:37:14.340577 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jun 16 12:37:14.340577 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jun 16 12:37:14.340577 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jun 16 12:37:14.340577 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 12:37:14.340577 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jun 16 12:37:14.340577 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jun 16 12:37:14.340577 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Id: 501ea87534094acaa1b0a50b01901cac Jun 16 12:37:14.340577 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-551653103 Jun 16 12:37:14.340577 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Role: member,reader Jun 16 12:37:14.340577 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Roles: member,reader Jun 16 12:37:14.342065 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/501ea87534094acaa1b0a50b01901cac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/501ea87534094acaa1b0a50b01901cac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_501ea87534094acaa1b0a50b01901cac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/501ea87534094acaa1b0a50b01901cac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Jun 16 12:37:14.342065 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-AttachVolumeShelveTestJSON-551653103 Jun 16 12:37:14.342065 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant-Id: 501ea87534094acaa1b0a50b01901cac Jun 16 12:37:14.342065 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-551653103 Jun 16 12:37:14.342065 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User: tempest-AttachVolumeShelveTestJSON-551653103-project Jun 16 12:37:14.342065 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jun 16 12:37:14.342065 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jun 16 12:37:14.342065 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Id: cb370edc0f094c04904eb093a9eb0a42 Jun 16 12:37:14.342065 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-AttachVolumeShelveTestJSON-551653103-project Jun 16 12:37:14.342065 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: method: > Jun 16 12:37:14.342065 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: exception: Instance f50c08e9-d310-424a-972c-1c16733a796e could not be found. Jun 16 12:37:14.342065 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: action_args: {'id': 'f50c08e9-d310-424a-972c-1c16733a796e'} Jun 16 12:37:14.342796 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:37:14.342796 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:37:14.342796 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:37:14.342796 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:37:14.342796 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:37:14.342796 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:37:14.342796 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:37:14.342796 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:37:14.342796 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:37:14.342796 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:37:14.342796 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f50c08e9-d310-424a-972c-1c16733a796e could not be found. Jun 16 12:37:14.342796 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:37:14.342796 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:37:14.342796 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:37:14.342796 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:37:14.342796 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:37:14.342796 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:37:14.342796 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:37:14.342796 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:37:14.342796 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:37:14.344021 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:37:14.344021 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 12:37:14.344021 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 12:37:14.344021 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 12:37:14.344021 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 12:37:14.344021 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:37:14.344021 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:37:14.344021 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:37:14.344021 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:37:14.344021 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f50c08e9-d310-424a-972c-1c16733a796e could not be found. Jun 16 12:37:14.344021 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:37:14.344021 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:37:14.344021 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:37:14.344021 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:37:14.344021 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:37:14.344021 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:37:14.344021 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:37:14.344021 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:37:14.344021 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f50c08e9-d310-424a-972c-1c16733a796e could not be found. Jun 16 12:37:14.344021 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:37:14.345386 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-bf74f8f1-c573-42e3-833f-8120e75e1163 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Returning 404 to user: Instance f50c08e9-d310-424a-972c-1c16733a796e could not be found. {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:37:14.345386 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-bf74f8f1-c573-42e3-833f-8120e75e1163 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "DELETE /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 404 len: 111 microversion: 2.20 time: 0.031758 Jun 16 12:37:14.345386 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 517/1025] 10.222.0.45 () {60 vars in 1279 bytes} [Thu Jun 16 12:37:14 2022] DELETE /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 12:37:14.352415 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c2ac3754-c80a-4c50-bf8f-6eb7aa32cd63 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:37:14.353105 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c2ac3754-c80a-4c50-bf8f-6eb7aa32cd63 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: f50c08e9-d310-424a-972c-1c16733a796e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:37:14.360008 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c2ac3754-c80a-4c50-bf8f-6eb7aa32cd63 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:14.361278 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c2ac3754-c80a-4c50-bf8f-6eb7aa32cd63 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:14.362258 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c2ac3754-c80a-4c50-bf8f-6eb7aa32cd63 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:14.363212 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c2ac3754-c80a-4c50-bf8f-6eb7aa32cd63 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:14.379623 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-c2ac3754-c80a-4c50-bf8f-6eb7aa32cd63 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] HTTP exception thrown: Instance f50c08e9-d310-424a-972c-1c16733a796e could not be found. Jun 16 12:37:14.381158 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c2ac3754-c80a-4c50-bf8f-6eb7aa32cd63 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Request method failure captured: Jun 16 12:37:14.381158 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: request: GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e HTTP/1.1 Jun 16 12:37:14.381158 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 16 12:37:14.381158 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 16 12:37:14.381158 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Connection: close Jun 16 12:37:14.381158 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 16 12:37:14.381158 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 16 12:37:14.381158 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Host: 10.222.0.45 Jun 16 12:37:14.381158 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 16 12:37:14.381158 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 16 12:37:14.381158 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABiqyGF45WJthPoje2fm_CkoZIB6HenyTxmCcWuoWEwLwDmGmYSmBO0DdCi7iivh_AJxLzcemhDXmPR5vvH45qL8qC_XPuYlBrA1x8oGGXWiuPkoeqCyenYIUhaTgwioAG2Eo7jiMG6peQL1gAPmaq76kMQ_e0BLllLSBNLTOsXKFAP7II Jun 16 12:37:14.381158 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 16 12:37:14.381158 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 16 12:37:14.381158 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 16 12:37:14.381158 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 16 12:37:14.381158 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 12:37:14.381158 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 16 12:37:14.381158 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 16 12:37:14.381158 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Id: 501ea87534094acaa1b0a50b01901cac Jun 16 12:37:14.381158 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-551653103 Jun 16 12:37:14.381158 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 16 12:37:14.381158 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 16 12:37:14.386014 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/501ea87534094acaa1b0a50b01901cac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/501ea87534094acaa1b0a50b01901cac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_501ea87534094acaa1b0a50b01901cac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/501ea87534094acaa1b0a50b01901cac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Jun 16 12:37:14.386014 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-AttachVolumeShelveTestJSON-551653103 Jun 16 12:37:14.386014 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 501ea87534094acaa1b0a50b01901cac Jun 16 12:37:14.386014 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-551653103 Jun 16 12:37:14.386014 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User: tempest-AttachVolumeShelveTestJSON-551653103-project Jun 16 12:37:14.386014 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 16 12:37:14.386014 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 16 12:37:14.386014 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Id: cb370edc0f094c04904eb093a9eb0a42 Jun 16 12:37:14.386014 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-AttachVolumeShelveTestJSON-551653103-project Jun 16 12:37:14.386014 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: method: > Jun 16 12:37:14.386014 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: exception: Instance f50c08e9-d310-424a-972c-1c16733a796e could not be found. Jun 16 12:37:14.386014 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: action_args: {'id': 'f50c08e9-d310-424a-972c-1c16733a796e'} Jun 16 12:37:14.386927 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:37:14.386927 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:37:14.386927 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:37:14.386927 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:37:14.386927 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:37:14.386927 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:37:14.386927 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:37:14.386927 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:37:14.386927 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:37:14.386927 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:37:14.386927 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f50c08e9-d310-424a-972c-1c16733a796e could not be found. Jun 16 12:37:14.386927 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:37:14.386927 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:37:14.386927 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:37:14.386927 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:37:14.386927 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:37:14.386927 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:37:14.386927 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:37:14.386927 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:37:14.386927 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:37:14.388646 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:37:14.388646 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 12:37:14.388646 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 12:37:14.388646 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:37:14.388646 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:37:14.388646 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:37:14.388646 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:37:14.388646 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f50c08e9-d310-424a-972c-1c16733a796e could not be found. Jun 16 12:37:14.388646 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:37:14.388646 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:37:14.388646 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:37:14.388646 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:37:14.388646 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:37:14.388646 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:37:14.388646 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:37:14.388646 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:37:14.388646 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f50c08e9-d310-424a-972c-1c16733a796e could not be found. Jun 16 12:37:14.388646 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:37:14.389857 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c2ac3754-c80a-4c50-bf8f-6eb7aa32cd63 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Returning 404 to user: Instance f50c08e9-d310-424a-972c-1c16733a796e could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:37:14.389857 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c2ac3754-c80a-4c50-bf8f-6eb7aa32cd63 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e" status: 404 len: 111 microversion: 2.20 time: 0.035836 Jun 16 12:37:14.389857 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 509/1026] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:37:14 2022] GET /compute/v2.1/servers/f50c08e9-d310-424a-972c-1c16733a796e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 12:37:15.535066 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f178a9d4-22af-494f-9578-4af50b1d26e3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:37:15.535670 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f178a9d4-22af-494f-9578-4af50b1d26e3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:37:15.543680 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f178a9d4-22af-494f-9578-4af50b1d26e3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:15.544496 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f178a9d4-22af-494f-9578-4af50b1d26e3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:15.545343 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f178a9d4-22af-494f-9578-4af50b1d26e3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:15.545851 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f178a9d4-22af-494f-9578-4af50b1d26e3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:15.561348 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-f178a9d4-22af-494f-9578-4af50b1d26e3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] HTTP exception thrown: Instance 8528919e-1e7a-4807-9b11-ae225e65d4df could not be found. Jun 16 12:37:15.563049 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f178a9d4-22af-494f-9578-4af50b1d26e3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Request method failure captured: Jun 16 12:37:15.563049 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: request: DELETE /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df HTTP/1.1 Jun 16 12:37:15.563049 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Accept: application/json Jun 16 12:37:15.563049 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jun 16 12:37:15.563049 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Connection: close Jun 16 12:37:15.563049 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jun 16 12:37:15.563049 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jun 16 12:37:15.563049 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Host: 10.222.0.45 Jun 16 12:37:15.563049 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jun 16 12:37:15.563049 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jun 16 12:37:15.563049 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABiqyGF45WJthPoje2fm_CkoZIB6HenyTxmCcWuoWEwLwDmGmYSmBO0DdCi7iivh_AJxLzcemhDXmPR5vvH45qL8qC_XPuYlBrA1x8oGGXWiuPkoeqCyenYIUhaTgwioAG2Eo7jiMG6peQL1gAPmaq76kMQ_e0BLllLSBNLTOsXKFAP7II Jun 16 12:37:15.563049 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jun 16 12:37:15.563049 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jun 16 12:37:15.563049 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jun 16 12:37:15.563049 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jun 16 12:37:15.563049 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 12:37:15.563049 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jun 16 12:37:15.563049 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jun 16 12:37:15.563049 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Id: 501ea87534094acaa1b0a50b01901cac Jun 16 12:37:15.563049 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-551653103 Jun 16 12:37:15.563049 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Role: member,reader Jun 16 12:37:15.563049 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Roles: member,reader Jun 16 12:37:15.565309 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/501ea87534094acaa1b0a50b01901cac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/501ea87534094acaa1b0a50b01901cac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_501ea87534094acaa1b0a50b01901cac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/501ea87534094acaa1b0a50b01901cac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Jun 16 12:37:15.565309 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-AttachVolumeShelveTestJSON-551653103 Jun 16 12:37:15.565309 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant-Id: 501ea87534094acaa1b0a50b01901cac Jun 16 12:37:15.565309 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-551653103 Jun 16 12:37:15.565309 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User: tempest-AttachVolumeShelveTestJSON-551653103-project Jun 16 12:37:15.565309 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jun 16 12:37:15.565309 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jun 16 12:37:15.565309 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Id: cb370edc0f094c04904eb093a9eb0a42 Jun 16 12:37:15.565309 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-AttachVolumeShelveTestJSON-551653103-project Jun 16 12:37:15.565309 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: method: > Jun 16 12:37:15.565309 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: exception: Instance 8528919e-1e7a-4807-9b11-ae225e65d4df could not be found. Jun 16 12:37:15.565309 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: action_args: {'id': '8528919e-1e7a-4807-9b11-ae225e65d4df'} Jun 16 12:37:15.566498 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:37:15.566498 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:37:15.566498 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:37:15.566498 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:37:15.566498 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:37:15.566498 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:37:15.566498 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:37:15.566498 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:37:15.566498 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:37:15.566498 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:37:15.566498 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8528919e-1e7a-4807-9b11-ae225e65d4df could not be found. Jun 16 12:37:15.566498 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:37:15.566498 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:37:15.566498 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:37:15.566498 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:37:15.566498 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:37:15.566498 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:37:15.566498 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:37:15.566498 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:37:15.566498 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:37:15.568249 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:37:15.568249 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 12:37:15.568249 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 12:37:15.568249 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 12:37:15.568249 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 12:37:15.568249 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:37:15.568249 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:37:15.568249 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:37:15.568249 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:37:15.568249 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8528919e-1e7a-4807-9b11-ae225e65d4df could not be found. Jun 16 12:37:15.568249 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:37:15.568249 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:37:15.568249 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:37:15.568249 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:37:15.568249 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:37:15.568249 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:37:15.568249 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:37:15.568249 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:37:15.568249 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8528919e-1e7a-4807-9b11-ae225e65d4df could not be found. Jun 16 12:37:15.568249 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:37:15.570849 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f178a9d4-22af-494f-9578-4af50b1d26e3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Returning 404 to user: Instance 8528919e-1e7a-4807-9b11-ae225e65d4df could not be found. {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:37:15.570849 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f178a9d4-22af-494f-9578-4af50b1d26e3 tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "DELETE /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 404 len: 111 microversion: 2.20 time: 0.034520 Jun 16 12:37:15.570849 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 518/1027] 10.222.0.45 () {60 vars in 1279 bytes} [Thu Jun 16 12:37:15 2022] DELETE /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 12:37:15.575896 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9f5e8296-7b0c-4756-9073-96365a46ce2e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:37:15.577525 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9f5e8296-7b0c-4756-9073-96365a46ce2e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] [instance: 8528919e-1e7a-4807-9b11-ae225e65d4df] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:37:15.583831 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9f5e8296-7b0c-4756-9073-96365a46ce2e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:15.584365 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9f5e8296-7b0c-4756-9073-96365a46ce2e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:15.585387 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9f5e8296-7b0c-4756-9073-96365a46ce2e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:15.585780 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9f5e8296-7b0c-4756-9073-96365a46ce2e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:15.603016 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-9f5e8296-7b0c-4756-9073-96365a46ce2e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] HTTP exception thrown: Instance 8528919e-1e7a-4807-9b11-ae225e65d4df could not be found. Jun 16 12:37:15.604450 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9f5e8296-7b0c-4756-9073-96365a46ce2e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Request method failure captured: Jun 16 12:37:15.604450 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: request: GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df HTTP/1.1 Jun 16 12:37:15.604450 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 16 12:37:15.604450 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 16 12:37:15.604450 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Connection: close Jun 16 12:37:15.604450 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 16 12:37:15.604450 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 16 12:37:15.604450 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Host: 10.222.0.45 Jun 16 12:37:15.604450 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 16 12:37:15.604450 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 16 12:37:15.604450 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABiqyGF45WJthPoje2fm_CkoZIB6HenyTxmCcWuoWEwLwDmGmYSmBO0DdCi7iivh_AJxLzcemhDXmPR5vvH45qL8qC_XPuYlBrA1x8oGGXWiuPkoeqCyenYIUhaTgwioAG2Eo7jiMG6peQL1gAPmaq76kMQ_e0BLllLSBNLTOsXKFAP7II Jun 16 12:37:15.604450 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 16 12:37:15.604450 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 16 12:37:15.604450 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 16 12:37:15.604450 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 16 12:37:15.604450 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 12:37:15.604450 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 16 12:37:15.604450 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 16 12:37:15.604450 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Id: 501ea87534094acaa1b0a50b01901cac Jun 16 12:37:15.604450 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-551653103 Jun 16 12:37:15.604450 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 16 12:37:15.604450 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 16 12:37:15.606108 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/501ea87534094acaa1b0a50b01901cac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/501ea87534094acaa1b0a50b01901cac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_501ea87534094acaa1b0a50b01901cac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/501ea87534094acaa1b0a50b01901cac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Jun 16 12:37:15.606108 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-AttachVolumeShelveTestJSON-551653103 Jun 16 12:37:15.606108 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 501ea87534094acaa1b0a50b01901cac Jun 16 12:37:15.606108 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-551653103 Jun 16 12:37:15.606108 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User: tempest-AttachVolumeShelveTestJSON-551653103-project Jun 16 12:37:15.606108 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 16 12:37:15.606108 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 16 12:37:15.606108 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Id: cb370edc0f094c04904eb093a9eb0a42 Jun 16 12:37:15.606108 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-AttachVolumeShelveTestJSON-551653103-project Jun 16 12:37:15.606108 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: method: > Jun 16 12:37:15.606108 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: exception: Instance 8528919e-1e7a-4807-9b11-ae225e65d4df could not be found. Jun 16 12:37:15.606108 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: action_args: {'id': '8528919e-1e7a-4807-9b11-ae225e65d4df'} Jun 16 12:37:15.607167 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:37:15.607167 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:37:15.607167 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:37:15.607167 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:37:15.607167 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:37:15.607167 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:37:15.607167 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:37:15.607167 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:37:15.607167 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:37:15.607167 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:37:15.607167 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8528919e-1e7a-4807-9b11-ae225e65d4df could not be found. Jun 16 12:37:15.607167 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:37:15.607167 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:37:15.607167 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:37:15.607167 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:37:15.607167 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:37:15.607167 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:37:15.607167 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:37:15.607167 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:37:15.607167 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:37:15.608700 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:37:15.608700 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 12:37:15.608700 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 12:37:15.608700 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:37:15.608700 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:37:15.608700 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:37:15.608700 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:37:15.608700 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8528919e-1e7a-4807-9b11-ae225e65d4df could not be found. Jun 16 12:37:15.608700 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:37:15.608700 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:37:15.608700 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:37:15.608700 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:37:15.608700 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:37:15.608700 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:37:15.608700 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:37:15.608700 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:37:15.608700 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8528919e-1e7a-4807-9b11-ae225e65d4df could not be found. Jun 16 12:37:15.608700 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:37:15.610108 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9f5e8296-7b0c-4756-9073-96365a46ce2e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] Returning 404 to user: Instance 8528919e-1e7a-4807-9b11-ae225e65d4df could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:37:15.610108 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9f5e8296-7b0c-4756-9073-96365a46ce2e tempest-AttachVolumeShelveTestJSON-551653103 tempest-AttachVolumeShelveTestJSON-551653103-project] 10.222.0.45 "GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df" status: 404 len: 111 microversion: 2.20 time: 0.035276 Jun 16 12:37:15.610108 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 510/1028] 10.222.0.45 () {60 vars in 1276 bytes} [Thu Jun 16 12:37:15 2022] GET /compute/v2.1/servers/8528919e-1e7a-4807-9b11-ae225e65d4df => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 12:37:21.593350 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d2278d75-bc7e-4045-9222-9a97d588c0ef tempest-VolumesTestJSON-765960656 tempest-VolumesTestJSON-765960656-project] Calling method '.version_select at 0x7f7c720ad700>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:37:21.768922 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d2278d75-bc7e-4045-9222-9a97d588c0ef tempest-VolumesTestJSON-765960656 tempest-VolumesTestJSON-765960656-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/7484421b-7607-44b3-9a1a-9a9bde7b72c4" status: 200 len: 351 microversion: 2.1 time: 0.179233 Jun 16 12:37:21.769755 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 519/1029] 10.222.0.45 () {58 vars in 1244 bytes} [Thu Jun 16 12:37:21 2022] GET /compute/v2.1/os-volumes/7484421b-7607-44b3-9a1a-9a9bde7b72c4 => generated 351 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:37:23.103672 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-69703a30-eca4-4b02-910f-ff7696ccc577 tempest-VolumesTestJSON-765960656 tempest-VolumesTestJSON-765960656-project] Calling method '.version_select at 0x7f7c7403c550>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:37:23.154165 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-69703a30-eca4-4b02-910f-ff7696ccc577 tempest-VolumesTestJSON-765960656 tempest-VolumesTestJSON-765960656-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/665d3ce3-d5a1-4e20-8733-764572a0877d" status: 200 len: 350 microversion: 2.1 time: 0.054661 Jun 16 12:37:23.154853 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 511/1030] 10.222.0.45 () {58 vars in 1244 bytes} [Thu Jun 16 12:37:23 2022] GET /compute/v2.1/os-volumes/665d3ce3-d5a1-4e20-8733-764572a0877d => generated 350 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:37:24.506455 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1ef6144f-ac61-48e5-a6f3-ac837754a990 tempest-VolumesTestJSON-765960656 tempest-VolumesTestJSON-765960656-project] Calling method '.version_select at 0x7f7c72b3a790>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:37:24.554545 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1ef6144f-ac61-48e5-a6f3-ac837754a990 tempest-VolumesTestJSON-765960656 tempest-VolumesTestJSON-765960656-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/10727f9b-eb97-484f-be9e-6564ab7b4dd2" status: 200 len: 351 microversion: 2.1 time: 0.052123 Jun 16 12:37:24.554979 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 520/1031] 10.222.0.45 () {58 vars in 1244 bytes} [Thu Jun 16 12:37:24 2022] GET /compute/v2.1/os-volumes/10727f9b-eb97-484f-be9e-6564ab7b4dd2 => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:37:24.566525 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0acfab3c-d169-44e2-a4ca-1791f04199d0 tempest-VolumesTestJSON-765960656 tempest-VolumesTestJSON-765960656-project] Calling method '.version_select at 0x7f7c72245af0>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:37:24.651852 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0acfab3c-d169-44e2-a4ca-1791f04199d0 tempest-VolumesTestJSON-765960656 tempest-VolumesTestJSON-765960656-project] 10.222.0.45 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.089272 Jun 16 12:37:24.652428 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 512/1032] 10.222.0.45 () {58 vars in 1133 bytes} [Thu Jun 16 12:37:24 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:37:24.664828 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8ee0b8f7-bdbb-4783-a6dc-48890fef2a37 tempest-VolumesTestJSON-765960656 tempest-VolumesTestJSON-765960656-project] Calling method '.version_select at 0x7f7c72115670>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:37:24.748722 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8ee0b8f7-bdbb-4783-a6dc-48890fef2a37 tempest-VolumesTestJSON-765960656 tempest-VolumesTestJSON-765960656-project] 10.222.0.45 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.088219 Jun 16 12:37:24.749292 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 521/1033] 10.222.0.45 () {58 vars in 1148 bytes} [Thu Jun 16 12:37:24 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:37:24.761301 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ad0e5781-0c70-414e-b93c-80118a9f6ded tempest-VolumesTestJSON-765960656 tempest-VolumesTestJSON-765960656-project] Calling method '.version_select at 0x7f7c721ea820>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:37:24.845789 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ad0e5781-0c70-414e-b93c-80118a9f6ded tempest-VolumesTestJSON-765960656 tempest-VolumesTestJSON-765960656-project] 10.222.0.45 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.088650 Jun 16 12:37:24.846400 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 513/1034] 10.222.0.45 () {58 vars in 1133 bytes} [Thu Jun 16 12:37:24 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:37:24.857782 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5ab1ab2b-89b4-4b62-bdad-9eefea09a1a8 tempest-VolumesTestJSON-765960656 tempest-VolumesTestJSON-765960656-project] Calling method '.version_select at 0x7f7c720e98b0>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:37:24.946750 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5ab1ab2b-89b4-4b62-bdad-9eefea09a1a8 tempest-VolumesTestJSON-765960656 tempest-VolumesTestJSON-765960656-project] 10.222.0.45 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.092771 Jun 16 12:37:24.947424 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 522/1035] 10.222.0.45 () {58 vars in 1166 bytes} [Thu Jun 16 12:37:24 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:37:24.960358 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4411bf3a-ee50-44be-9778-8fb196e2f35b tempest-VolumesTestJSON-765960656 tempest-VolumesTestJSON-765960656-project] Calling method '.version_select at 0x7f7c7403c550>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:37:25.049995 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4411bf3a-ee50-44be-9778-8fb196e2f35b tempest-VolumesTestJSON-765960656 tempest-VolumesTestJSON-765960656-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.093693 Jun 16 12:37:25.061157 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 514/1036] 10.222.0.45 () {58 vars in 1169 bytes} [Thu Jun 16 12:37:24 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:37:25.067621 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5da0bdff-502d-4386-8def-3d7734b660f8 tempest-VolumesTestJSON-765960656 tempest-VolumesTestJSON-765960656-project] Calling method '.version_select at 0x7f7c721a79d0>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:37:25.149210 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5da0bdff-502d-4386-8def-3d7734b660f8 tempest-VolumesTestJSON-765960656 tempest-VolumesTestJSON-765960656-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.085245 Jun 16 12:37:25.149773 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 523/1037] 10.222.0.45 () {58 vars in 1154 bytes} [Thu Jun 16 12:37:25 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:37:25.161232 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a100e209-a76f-4aa0-a9bb-ae025bd281b6 tempest-VolumesTestJSON-765960656 tempest-VolumesTestJSON-765960656-project] Calling method '.version_select at 0x7f7c721e0dc0>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:37:25.243337 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a100e209-a76f-4aa0-a9bb-ae025bd281b6 tempest-VolumesTestJSON-765960656 tempest-VolumesTestJSON-765960656-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.085874 Jun 16 12:37:25.243937 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 515/1038] 10.222.0.45 () {58 vars in 1187 bytes} [Thu Jun 16 12:37:25 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:37:25.255269 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3e940618-62af-44fc-84d4-b23eee9ddc54 tempest-VolumesTestJSON-765960656 tempest-VolumesTestJSON-765960656-project] Calling method '.version_select at 0x7f7c72b3a9d0>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:37:25.335188 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3e940618-62af-44fc-84d4-b23eee9ddc54 tempest-VolumesTestJSON-765960656 tempest-VolumesTestJSON-765960656-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.083579 Jun 16 12:37:25.335751 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 524/1039] 10.222.0.45 () {58 vars in 1154 bytes} [Thu Jun 16 12:37:25 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:37:33.215969 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:37:33.216710 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=65,nova_cell1:INSERT=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:37:33.222969 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9f6deab7-e14a-4999-9252-63ff4b525519 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:37:33.223226 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9f6deab7-e14a-4999-9252-63ff4b525519 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: 8e91b2d7-1250-4cca-965d-c18107d8c3a1] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:37:33.232466 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9f6deab7-e14a-4999-9252-63ff4b525519 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:33.233057 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9f6deab7-e14a-4999-9252-63ff4b525519 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:33.233981 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9f6deab7-e14a-4999-9252-63ff4b525519 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:33.234423 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9f6deab7-e14a-4999-9252-63ff4b525519 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:33.318195 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.objects.instance [None req-9f6deab7-e14a-4999-9252-63ff4b525519 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lazy-loading 'services' on Instance uuid 8e91b2d7-1250-4cca-965d-c18107d8c3a1 {{(pid=117606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 12:37:33.402274 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9f6deab7-e14a-4999-9252-63ff4b525519 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "DELETE /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1/os-volume_attachments/33e1c91e-3849-4d10-a484-334739e0efd4" status: 202 len: 0 microversion: 2.1 time: 0.187038 Jun 16 12:37:33.415759 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 516/1040] 10.222.0.45 () {58 vars in 1415 bytes} [Thu Jun 16 12:37:33 2022] DELETE /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1/os-volume_attachments/33e1c91e-3849-4d10-a484-334739e0efd4 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 12:37:38.908303 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:37:38.909062 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:37:38.913348 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d1b829a0-15af-447a-a8e8-11c138d44c27 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:37:38.921580 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d1b829a0-15af-447a-a8e8-11c138d44c27 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:38.922058 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d1b829a0-15af-447a-a8e8-11c138d44c27 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:38.946008 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d1b829a0-15af-447a-a8e8-11c138d44c27 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: 8e91b2d7-1250-4cca-965d-c18107d8c3a1] Going to try to stop instance {{(pid=117607) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 16 12:37:38.990758 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d1b829a0-15af-447a-a8e8-11c138d44c27 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "POST /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1/action" status: 202 len: 0 microversion: 2.1 time: 0.083613 Jun 16 12:37:38.991552 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 525/1041] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Jun 16 12:37:38 2022] POST /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 12:37:39.009301 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-adfafc6b-8c31-4439-b158-ea9cd20ef8d8 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:37:39.009301 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-adfafc6b-8c31-4439-b158-ea9cd20ef8d8 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: 8e91b2d7-1250-4cca-965d-c18107d8c3a1] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:37:39.015404 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-adfafc6b-8c31-4439-b158-ea9cd20ef8d8 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:39.015938 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-adfafc6b-8c31-4439-b158-ea9cd20ef8d8 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:39.016646 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-adfafc6b-8c31-4439-b158-ea9cd20ef8d8 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:39.017077 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-adfafc6b-8c31-4439-b158-ea9cd20ef8d8 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:39.159810 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-adfafc6b-8c31-4439-b158-ea9cd20ef8d8 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e53fdd4ca2b4fd8b64caea6924fa969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb62ca3babf9402996e0ef47fc0d8e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:37:39.167639 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-adfafc6b-8c31-4439-b158-ea9cd20ef8d8 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1" status: 200 len: 1676 microversion: 2.1 time: 0.170938 Jun 16 12:37:39.168204 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 517/1042] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:37:38 2022] GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1 => generated 1676 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:37:40.185982 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-82f85f33-1942-4147-90ae-0688afefd80d tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:37:40.186684 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-82f85f33-1942-4147-90ae-0688afefd80d tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: 8e91b2d7-1250-4cca-965d-c18107d8c3a1] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:37:40.193330 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-82f85f33-1942-4147-90ae-0688afefd80d tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:40.193785 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-82f85f33-1942-4147-90ae-0688afefd80d tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:40.194575 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-82f85f33-1942-4147-90ae-0688afefd80d tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:40.195026 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-82f85f33-1942-4147-90ae-0688afefd80d tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:40.324327 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-82f85f33-1942-4147-90ae-0688afefd80d tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e53fdd4ca2b4fd8b64caea6924fa969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb62ca3babf9402996e0ef47fc0d8e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:37:40.331802 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-82f85f33-1942-4147-90ae-0688afefd80d tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1" status: 200 len: 1676 microversion: 2.1 time: 0.150112 Jun 16 12:37:40.332357 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 526/1043] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:37:40 2022] GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:37:41.348960 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c3d73db3-1f5f-4293-8b37-f92f9e691c29 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:37:41.349691 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c3d73db3-1f5f-4293-8b37-f92f9e691c29 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: 8e91b2d7-1250-4cca-965d-c18107d8c3a1] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:37:41.356406 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c3d73db3-1f5f-4293-8b37-f92f9e691c29 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:41.356856 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c3d73db3-1f5f-4293-8b37-f92f9e691c29 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:41.357625 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c3d73db3-1f5f-4293-8b37-f92f9e691c29 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:41.358094 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c3d73db3-1f5f-4293-8b37-f92f9e691c29 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:41.485905 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c3d73db3-1f5f-4293-8b37-f92f9e691c29 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e53fdd4ca2b4fd8b64caea6924fa969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb62ca3babf9402996e0ef47fc0d8e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:37:41.494384 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c3d73db3-1f5f-4293-8b37-f92f9e691c29 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1" status: 200 len: 1676 microversion: 2.1 time: 0.149283 Jun 16 12:37:41.494944 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 518/1044] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:37:41 2022] GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1 => generated 1676 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:37:42.512216 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0262659d-fe7c-4411-bd28-cd4e36bcd14f tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:37:42.512835 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0262659d-fe7c-4411-bd28-cd4e36bcd14f tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: 8e91b2d7-1250-4cca-965d-c18107d8c3a1] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:37:42.519381 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0262659d-fe7c-4411-bd28-cd4e36bcd14f tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:42.519816 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0262659d-fe7c-4411-bd28-cd4e36bcd14f tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:42.520592 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0262659d-fe7c-4411-bd28-cd4e36bcd14f tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:42.521041 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0262659d-fe7c-4411-bd28-cd4e36bcd14f tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:42.689020 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0262659d-fe7c-4411-bd28-cd4e36bcd14f tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e53fdd4ca2b4fd8b64caea6924fa969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb62ca3babf9402996e0ef47fc0d8e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:37:42.697411 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0262659d-fe7c-4411-bd28-cd4e36bcd14f tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1" status: 200 len: 1676 microversion: 2.1 time: 0.189662 Jun 16 12:37:42.698229 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 527/1045] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:37:42 2022] GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1 => generated 1676 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:37:43.714984 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a9fa6fb1-9712-4f83-9679-8523f69e8c66 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:37:43.715592 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a9fa6fb1-9712-4f83-9679-8523f69e8c66 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: 8e91b2d7-1250-4cca-965d-c18107d8c3a1] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:37:43.722193 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a9fa6fb1-9712-4f83-9679-8523f69e8c66 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:43.722639 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a9fa6fb1-9712-4f83-9679-8523f69e8c66 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:43.723399 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a9fa6fb1-9712-4f83-9679-8523f69e8c66 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:43.723831 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a9fa6fb1-9712-4f83-9679-8523f69e8c66 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:43.859518 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a9fa6fb1-9712-4f83-9679-8523f69e8c66 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e53fdd4ca2b4fd8b64caea6924fa969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb62ca3babf9402996e0ef47fc0d8e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:37:43.867516 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a9fa6fb1-9712-4f83-9679-8523f69e8c66 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1" status: 200 len: 1676 microversion: 2.1 time: 0.156188 Jun 16 12:37:43.868079 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 519/1046] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:37:43 2022] GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1 => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:37:44.886561 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-cb3679c8-c2c9-4081-8dbe-eec894b392ea tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:37:44.887486 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-cb3679c8-c2c9-4081-8dbe-eec894b392ea tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: 8e91b2d7-1250-4cca-965d-c18107d8c3a1] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:37:44.894048 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cb3679c8-c2c9-4081-8dbe-eec894b392ea tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:44.894495 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cb3679c8-c2c9-4081-8dbe-eec894b392ea tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:44.895257 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cb3679c8-c2c9-4081-8dbe-eec894b392ea tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:44.895756 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cb3679c8-c2c9-4081-8dbe-eec894b392ea tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:45.043596 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-cb3679c8-c2c9-4081-8dbe-eec894b392ea tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e53fdd4ca2b4fd8b64caea6924fa969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb62ca3babf9402996e0ef47fc0d8e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:37:45.051768 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-cb3679c8-c2c9-4081-8dbe-eec894b392ea tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1" status: 200 len: 1676 microversion: 2.1 time: 0.170460 Jun 16 12:37:45.052424 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 528/1047] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:37:44 2022] GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1 => generated 1676 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:37:46.071394 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6485b5a1-0b04-4bef-a3f1-d19d1f0fba18 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:37:46.072024 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6485b5a1-0b04-4bef-a3f1-d19d1f0fba18 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: 8e91b2d7-1250-4cca-965d-c18107d8c3a1] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:37:46.078392 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6485b5a1-0b04-4bef-a3f1-d19d1f0fba18 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:46.078839 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6485b5a1-0b04-4bef-a3f1-d19d1f0fba18 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:46.079601 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6485b5a1-0b04-4bef-a3f1-d19d1f0fba18 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:46.080041 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6485b5a1-0b04-4bef-a3f1-d19d1f0fba18 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:46.205197 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6485b5a1-0b04-4bef-a3f1-d19d1f0fba18 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e53fdd4ca2b4fd8b64caea6924fa969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb62ca3babf9402996e0ef47fc0d8e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:37:46.213353 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6485b5a1-0b04-4bef-a3f1-d19d1f0fba18 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1" status: 200 len: 1676 microversion: 2.1 time: 0.146543 Jun 16 12:37:46.213927 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 520/1048] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:37:46 2022] GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1 => generated 1676 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:37:47.230581 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1e52c3f4-98e5-47ae-aa75-840bde2f5b3f tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:37:47.231137 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1e52c3f4-98e5-47ae-aa75-840bde2f5b3f tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: 8e91b2d7-1250-4cca-965d-c18107d8c3a1] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:37:47.237614 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1e52c3f4-98e5-47ae-aa75-840bde2f5b3f tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:47.238116 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1e52c3f4-98e5-47ae-aa75-840bde2f5b3f tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:47.238891 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1e52c3f4-98e5-47ae-aa75-840bde2f5b3f tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:47.239335 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1e52c3f4-98e5-47ae-aa75-840bde2f5b3f tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:47.370531 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1e52c3f4-98e5-47ae-aa75-840bde2f5b3f tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e53fdd4ca2b4fd8b64caea6924fa969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb62ca3babf9402996e0ef47fc0d8e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:37:47.378059 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1e52c3f4-98e5-47ae-aa75-840bde2f5b3f tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1" status: 200 len: 1676 microversion: 2.1 time: 0.151920 Jun 16 12:37:47.378628 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 529/1049] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:37:47 2022] GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:37:48.395237 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-13b65308-036c-41ef-995a-96bf09ae6994 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:37:48.395850 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-13b65308-036c-41ef-995a-96bf09ae6994 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: 8e91b2d7-1250-4cca-965d-c18107d8c3a1] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:37:48.403497 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-13b65308-036c-41ef-995a-96bf09ae6994 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:48.403950 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-13b65308-036c-41ef-995a-96bf09ae6994 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:48.404700 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-13b65308-036c-41ef-995a-96bf09ae6994 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:48.405133 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-13b65308-036c-41ef-995a-96bf09ae6994 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:48.532047 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-13b65308-036c-41ef-995a-96bf09ae6994 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e53fdd4ca2b4fd8b64caea6924fa969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb62ca3babf9402996e0ef47fc0d8e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:37:48.539895 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-13b65308-036c-41ef-995a-96bf09ae6994 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1" status: 200 len: 1676 microversion: 2.1 time: 0.148507 Jun 16 12:37:48.540457 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 521/1050] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:37:48 2022] GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1 => generated 1676 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:37:49.557788 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ca2c8931-b75f-49bb-9a54-e690fe8229f0 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:37:49.558564 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ca2c8931-b75f-49bb-9a54-e690fe8229f0 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: 8e91b2d7-1250-4cca-965d-c18107d8c3a1] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:37:49.564939 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ca2c8931-b75f-49bb-9a54-e690fe8229f0 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:49.565389 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ca2c8931-b75f-49bb-9a54-e690fe8229f0 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:49.566183 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ca2c8931-b75f-49bb-9a54-e690fe8229f0 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:49.566622 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ca2c8931-b75f-49bb-9a54-e690fe8229f0 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:49.691889 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ca2c8931-b75f-49bb-9a54-e690fe8229f0 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e53fdd4ca2b4fd8b64caea6924fa969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb62ca3babf9402996e0ef47fc0d8e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:37:49.699990 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ca2c8931-b75f-49bb-9a54-e690fe8229f0 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1" status: 200 len: 1676 microversion: 2.1 time: 0.146584 Jun 16 12:37:49.700572 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 530/1051] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:37:49 2022] GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1 => generated 1676 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:37:50.716992 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0b43c541-9a4f-4212-b44d-c0abee9a74a4 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:37:50.717602 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0b43c541-9a4f-4212-b44d-c0abee9a74a4 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: 8e91b2d7-1250-4cca-965d-c18107d8c3a1] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:37:50.724137 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0b43c541-9a4f-4212-b44d-c0abee9a74a4 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:50.724585 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0b43c541-9a4f-4212-b44d-c0abee9a74a4 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:50.725341 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0b43c541-9a4f-4212-b44d-c0abee9a74a4 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:50.725773 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0b43c541-9a4f-4212-b44d-c0abee9a74a4 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:50.854712 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0b43c541-9a4f-4212-b44d-c0abee9a74a4 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e53fdd4ca2b4fd8b64caea6924fa969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb62ca3babf9402996e0ef47fc0d8e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:37:50.862201 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0b43c541-9a4f-4212-b44d-c0abee9a74a4 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1" status: 200 len: 1676 microversion: 2.1 time: 0.149020 Jun 16 12:37:50.862762 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 522/1052] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:37:50 2022] GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1 => generated 1676 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:37:51.880090 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-295fca44-5c53-42f2-87d5-fa541d0a6d2c tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:37:51.880670 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-295fca44-5c53-42f2-87d5-fa541d0a6d2c tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: 8e91b2d7-1250-4cca-965d-c18107d8c3a1] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:37:51.887285 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-295fca44-5c53-42f2-87d5-fa541d0a6d2c tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:51.887731 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-295fca44-5c53-42f2-87d5-fa541d0a6d2c tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:51.888494 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-295fca44-5c53-42f2-87d5-fa541d0a6d2c tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:51.888931 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-295fca44-5c53-42f2-87d5-fa541d0a6d2c tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:52.019696 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-295fca44-5c53-42f2-87d5-fa541d0a6d2c tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e53fdd4ca2b4fd8b64caea6924fa969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb62ca3babf9402996e0ef47fc0d8e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:37:52.027938 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-295fca44-5c53-42f2-87d5-fa541d0a6d2c tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1" status: 200 len: 1676 microversion: 2.1 time: 0.151829 Jun 16 12:37:52.028507 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 531/1053] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:37:51 2022] GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:37:53.050235 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2da96da6-bdbb-4dc7-a7b7-fd5ecf525ebb tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:37:53.050761 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2da96da6-bdbb-4dc7-a7b7-fd5ecf525ebb tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: 8e91b2d7-1250-4cca-965d-c18107d8c3a1] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:37:53.058037 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2da96da6-bdbb-4dc7-a7b7-fd5ecf525ebb tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:53.058487 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2da96da6-bdbb-4dc7-a7b7-fd5ecf525ebb tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:53.059250 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2da96da6-bdbb-4dc7-a7b7-fd5ecf525ebb tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:53.059683 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2da96da6-bdbb-4dc7-a7b7-fd5ecf525ebb tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:53.190258 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2da96da6-bdbb-4dc7-a7b7-fd5ecf525ebb tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e53fdd4ca2b4fd8b64caea6924fa969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb62ca3babf9402996e0ef47fc0d8e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:37:53.198163 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2da96da6-bdbb-4dc7-a7b7-fd5ecf525ebb tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1" status: 200 len: 1653 microversion: 2.1 time: 0.155261 Jun 16 12:37:53.198730 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 523/1054] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:37:53 2022] GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1 => generated 1653 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:37:53.214789 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-59e1ec55-8c48-4cee-9267-cd5666f01bb0 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:37:53.221345 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-59e1ec55-8c48-4cee-9267-cd5666f01bb0 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:53.221796 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-59e1ec55-8c48-4cee-9267-cd5666f01bb0 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:53.246918 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-59e1ec55-8c48-4cee-9267-cd5666f01bb0 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: 8e91b2d7-1250-4cca-965d-c18107d8c3a1] Going to try to start instance {{(pid=117607) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 16 12:37:53.289338 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-59e1ec55-8c48-4cee-9267-cd5666f01bb0 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "POST /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1/action" status: 202 len: 0 microversion: 2.1 time: 0.077914 Jun 16 12:37:53.289954 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 532/1055] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Jun 16 12:37:53 2022] POST /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 12:37:53.298269 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6de4e583-b7cf-4bfa-9094-6e822f28d87e tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:37:53.298900 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6de4e583-b7cf-4bfa-9094-6e822f28d87e tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: 8e91b2d7-1250-4cca-965d-c18107d8c3a1] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:37:53.305096 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6de4e583-b7cf-4bfa-9094-6e822f28d87e tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:53.305457 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6de4e583-b7cf-4bfa-9094-6e822f28d87e tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:53.306324 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6de4e583-b7cf-4bfa-9094-6e822f28d87e tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:53.306756 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6de4e583-b7cf-4bfa-9094-6e822f28d87e tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:53.468488 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6de4e583-b7cf-4bfa-9094-6e822f28d87e tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e53fdd4ca2b4fd8b64caea6924fa969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb62ca3babf9402996e0ef47fc0d8e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:37:53.477050 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6de4e583-b7cf-4bfa-9094-6e822f28d87e tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1" status: 200 len: 1662 microversion: 2.1 time: 0.181760 Jun 16 12:37:53.477619 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 524/1056] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:37:53 2022] GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1 => generated 1662 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:37:54.496530 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-bc73335b-eeaa-4f02-b81a-8e46ebdad5a6 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:37:54.497359 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-bc73335b-eeaa-4f02-b81a-8e46ebdad5a6 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: 8e91b2d7-1250-4cca-965d-c18107d8c3a1] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:37:54.503979 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bc73335b-eeaa-4f02-b81a-8e46ebdad5a6 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:54.504436 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bc73335b-eeaa-4f02-b81a-8e46ebdad5a6 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:54.505221 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bc73335b-eeaa-4f02-b81a-8e46ebdad5a6 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:54.505665 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bc73335b-eeaa-4f02-b81a-8e46ebdad5a6 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:54.803417 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-bc73335b-eeaa-4f02-b81a-8e46ebdad5a6 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e53fdd4ca2b4fd8b64caea6924fa969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb62ca3babf9402996e0ef47fc0d8e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:37:54.811845 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-bc73335b-eeaa-4f02-b81a-8e46ebdad5a6 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1" status: 200 len: 1662 microversion: 2.1 time: 0.321022 Jun 16 12:37:54.812417 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 533/1057] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:37:54 2022] GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1 => generated 1662 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:37:55.828324 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-743bd00a-f7d2-4e98-9a5d-76e6793e8814 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:37:55.828940 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-743bd00a-f7d2-4e98-9a5d-76e6793e8814 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: 8e91b2d7-1250-4cca-965d-c18107d8c3a1] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:37:55.835379 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-743bd00a-f7d2-4e98-9a5d-76e6793e8814 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:55.835836 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-743bd00a-f7d2-4e98-9a5d-76e6793e8814 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:55.837153 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-743bd00a-f7d2-4e98-9a5d-76e6793e8814 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:37:55.837597 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-743bd00a-f7d2-4e98-9a5d-76e6793e8814 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:37:55.980238 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-743bd00a-f7d2-4e98-9a5d-76e6793e8814 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e53fdd4ca2b4fd8b64caea6924fa969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb62ca3babf9402996e0ef47fc0d8e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:37:55.989644 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-743bd00a-f7d2-4e98-9a5d-76e6793e8814 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1" status: 200 len: 1666 microversion: 2.1 time: 0.164939 Jun 16 12:37:56.001393 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 525/1058] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:37:55 2022] GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1 => generated 1666 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:38:10.418844 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6e2afd4a-b3d9-4cda-a712-596f3e9ad02b tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:38:10.419459 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6e2afd4a-b3d9-4cda-a712-596f3e9ad02b tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] [instance: 198edd63-e22e-42ca-8c37-89b4f87bab60] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:38:10.421749 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=18 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:38:10.422974 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:38:10.428661 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6e2afd4a-b3d9-4cda-a712-596f3e9ad02b tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:38:10.429444 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6e2afd4a-b3d9-4cda-a712-596f3e9ad02b tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:38:10.430404 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=20 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:38:10.431126 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6e2afd4a-b3d9-4cda-a712-596f3e9ad02b tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:38:10.431630 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=63,nova_cell1:INSERT=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:38:10.433073 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6e2afd4a-b3d9-4cda-a712-596f3e9ad02b tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:38:10.464103 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6e2afd4a-b3d9-4cda-a712-596f3e9ad02b tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] [instance: 198edd63-e22e-42ca-8c37-89b4f87bab60] Going to try to terminate instance {{(pid=117607) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 12:38:10.564323 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6e2afd4a-b3d9-4cda-a712-596f3e9ad02b tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] 10.222.0.45 "DELETE /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60" status: 204 len: 0 microversion: 2.1 time: 0.149329 Jun 16 12:38:10.568710 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 534/1059] 10.222.0.45 () {58 vars in 1238 bytes} [Thu Jun 16 12:38:10 2022] DELETE /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 12:38:10.574771 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-bf29eb89-643e-49ae-b8ef-c9d515d5325b tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:38:10.575482 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-bf29eb89-643e-49ae-b8ef-c9d515d5325b tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] [instance: 198edd63-e22e-42ca-8c37-89b4f87bab60] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:38:10.581713 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bf29eb89-643e-49ae-b8ef-c9d515d5325b tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:38:10.582195 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bf29eb89-643e-49ae-b8ef-c9d515d5325b tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:38:10.582968 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bf29eb89-643e-49ae-b8ef-c9d515d5325b tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:38:10.583629 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bf29eb89-643e-49ae-b8ef-c9d515d5325b tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:38:10.636231 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-f29f748e-bd32-4a21-b1c3-ee81a2652657 req-7d992639-068e-49f4-b5c0-2bb06fea1b8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "198edd63-e22e-42ca-8c37-89b4f87bab60", "tag": "9d06019c-16e2-447d-a476-b5bcbaca8ea9"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:38:10.648069 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-f29f748e-bd32-4a21-b1c3-ee81a2652657 req-7d992639-068e-49f4-b5c0-2bb06fea1b8f service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:38:10.648527 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-f29f748e-bd32-4a21-b1c3-ee81a2652657 req-7d992639-068e-49f4-b5c0-2bb06fea1b8f service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:38:10.660799 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-f29f748e-bd32-4a21-b1c3-ee81a2652657 req-7d992639-068e-49f4-b5c0-2bb06fea1b8f service nova] Creating event network-changed:9d06019c-16e2-447d-a476-b5bcbaca8ea9 for instance 198edd63-e22e-42ca-8c37-89b4f87bab60 on hv-cinder-84614 Jun 16 12:38:10.666692 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-f29f748e-bd32-4a21-b1c3-ee81a2652657 req-7d992639-068e-49f4-b5c0-2bb06fea1b8f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.242196 Jun 16 12:38:10.668043 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 526/1060] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:38:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:38:10.741248 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-bf29eb89-643e-49ae-b8ef-c9d515d5325b tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f18557a45846c1bd9075f8a0717652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf2d3eca81148afa04159506decfdce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:38:10.751196 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-bf29eb89-643e-49ae-b8ef-c9d515d5325b tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] 10.222.0.45 "GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60" status: 200 len: 1569 microversion: 2.1 time: 0.181094 Jun 16 12:38:10.752049 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 535/1061] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:38:10 2022] GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60 => generated 1569 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:38:11.771374 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-21511bf1-d18b-46e0-acb1-61e642c8a1bb tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:38:11.772165 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-21511bf1-d18b-46e0-acb1-61e642c8a1bb tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] [instance: 198edd63-e22e-42ca-8c37-89b4f87bab60] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:38:11.782869 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-21511bf1-d18b-46e0-acb1-61e642c8a1bb tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:38:11.783426 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-21511bf1-d18b-46e0-acb1-61e642c8a1bb tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:38:11.784241 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-21511bf1-d18b-46e0-acb1-61e642c8a1bb tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:38:11.784678 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-21511bf1-d18b-46e0-acb1-61e642c8a1bb tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:38:11.963816 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-21511bf1-d18b-46e0-acb1-61e642c8a1bb tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f18557a45846c1bd9075f8a0717652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf2d3eca81148afa04159506decfdce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:38:11.971388 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-21511bf1-d18b-46e0-acb1-61e642c8a1bb tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] 10.222.0.45 "GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60" status: 200 len: 1569 microversion: 2.1 time: 0.204463 Jun 16 12:38:11.971941 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 527/1062] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:38:11 2022] GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60 => generated 1569 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:38:12.988582 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-24baf78b-7416-44e5-a544-017863c6d335 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:38:12.989197 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-24baf78b-7416-44e5-a544-017863c6d335 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] [instance: 198edd63-e22e-42ca-8c37-89b4f87bab60] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:38:12.996126 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-24baf78b-7416-44e5-a544-017863c6d335 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:38:12.996608 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-24baf78b-7416-44e5-a544-017863c6d335 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:38:12.997375 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-24baf78b-7416-44e5-a544-017863c6d335 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:38:12.997814 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-24baf78b-7416-44e5-a544-017863c6d335 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:38:13.202951 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-24baf78b-7416-44e5-a544-017863c6d335 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f18557a45846c1bd9075f8a0717652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf2d3eca81148afa04159506decfdce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:38:13.210476 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-24baf78b-7416-44e5-a544-017863c6d335 tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] 10.222.0.45 "GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60" status: 200 len: 1451 microversion: 2.1 time: 0.225778 Jun 16 12:38:13.211046 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 536/1063] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:38:12 2022] GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60 => generated 1451 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:38:13.391630 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-99687125-3caa-4946-92c1-f4c45677ddd3 req-6e058a60-267a-4c19-aa77-fb1c12b030bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "198edd63-e22e-42ca-8c37-89b4f87bab60", "name": "network-vif-deleted", "tag": "9d06019c-16e2-447d-a476-b5bcbaca8ea9"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:38:13.394036 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-99687125-3caa-4946-92c1-f4c45677ddd3 req-6e058a60-267a-4c19-aa77-fb1c12b030bd service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:38:13.395386 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-99687125-3caa-4946-92c1-f4c45677ddd3 req-6e058a60-267a-4c19-aa77-fb1c12b030bd service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:38:13.410078 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-99687125-3caa-4946-92c1-f4c45677ddd3 req-6e058a60-267a-4c19-aa77-fb1c12b030bd service nova] Creating event network-vif-deleted:9d06019c-16e2-447d-a476-b5bcbaca8ea9 for instance 198edd63-e22e-42ca-8c37-89b4f87bab60 on hv-cinder-84614 Jun 16 12:38:13.417393 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-99687125-3caa-4946-92c1-f4c45677ddd3 req-6e058a60-267a-4c19-aa77-fb1c12b030bd service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036458 Jun 16 12:38:13.418014 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 528/1064] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:38:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:38:14.227194 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2b938c7b-33eb-420b-89e0-482953e48a5d tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:38:14.227900 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2b938c7b-33eb-420b-89e0-482953e48a5d tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] [instance: 198edd63-e22e-42ca-8c37-89b4f87bab60] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:38:14.235193 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2b938c7b-33eb-420b-89e0-482953e48a5d tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:38:14.235643 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2b938c7b-33eb-420b-89e0-482953e48a5d tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:38:14.236408 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2b938c7b-33eb-420b-89e0-482953e48a5d tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:38:14.236848 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2b938c7b-33eb-420b-89e0-482953e48a5d tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:38:14.251504 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-2b938c7b-33eb-420b-89e0-482953e48a5d tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] HTTP exception thrown: Instance 198edd63-e22e-42ca-8c37-89b4f87bab60 could not be found. Jun 16 12:38:14.253148 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2b938c7b-33eb-420b-89e0-482953e48a5d tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Request method failure captured: Jun 16 12:38:14.253148 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: request: GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60 HTTP/1.1 Jun 16 12:38:14.253148 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Accept: application/json Jun 16 12:38:14.253148 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jun 16 12:38:14.253148 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Connection: close Jun 16 12:38:14.253148 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jun 16 12:38:14.253148 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jun 16 12:38:14.253148 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Host: 10.222.0.45 Jun 16 12:38:14.253148 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jun 16 12:38:14.253148 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jun 16 12:38:14.253148 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABiqyLxraJ4eZR9QEAuJvGjYYZlD0UlZor8ngQPv7wZ3K89YmXjXdyTAjYliyrMyhPjb_KIk3njG4iuyBhDg55TxMddCGwBVm4y5FiV6C0HI9_g2WCj8GYrRUwMrMUlb-KDscBNyToP3M9tzNhxa8OBzPmxTz_cK3p0LoW_j_g1z7pVLF8 Jun 16 12:38:14.253148 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jun 16 12:38:14.253148 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jun 16 12:38:14.253148 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jun 16 12:38:14.253148 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jun 16 12:38:14.253148 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jun 16 12:38:14.253148 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jun 16 12:38:14.253148 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Id: 9cf2d3eca81148afa04159506decfdce Jun 16 12:38:14.253148 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-TestShelveInstance-55869699 Jun 16 12:38:14.253148 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Role: member,reader Jun 16 12:38:14.253148 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Roles: member,reader Jun 16 12:38:14.254885 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/9cf2d3eca81148afa04159506decfdce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9cf2d3eca81148afa04159506decfdce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_9cf2d3eca81148afa04159506decfdce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9cf2d3eca81148afa04159506decfdce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Jun 16 12:38:14.254885 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-TestShelveInstance-55869699 Jun 16 12:38:14.254885 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant-Id: 9cf2d3eca81148afa04159506decfdce Jun 16 12:38:14.254885 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-TestShelveInstance-55869699 Jun 16 12:38:14.254885 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User: tempest-TestShelveInstance-55869699-project Jun 16 12:38:14.254885 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jun 16 12:38:14.254885 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jun 16 12:38:14.254885 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Id: 46f18557a45846c1bd9075f8a0717652 Jun 16 12:38:14.254885 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-TestShelveInstance-55869699-project Jun 16 12:38:14.254885 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: method: > Jun 16 12:38:14.254885 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: exception: Instance 198edd63-e22e-42ca-8c37-89b4f87bab60 could not be found. Jun 16 12:38:14.254885 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: action_args: {'id': '198edd63-e22e-42ca-8c37-89b4f87bab60'} Jun 16 12:38:14.256016 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:38:14.256016 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:38:14.256016 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:38:14.256016 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:38:14.256016 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:38:14.256016 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:38:14.256016 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:38:14.256016 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:38:14.256016 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:38:14.256016 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:38:14.256016 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 198edd63-e22e-42ca-8c37-89b4f87bab60 could not be found. Jun 16 12:38:14.256016 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:38:14.256016 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:38:14.256016 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:38:14.256016 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:38:14.256016 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:38:14.256016 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:38:14.256016 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:38:14.256016 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:38:14.256016 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:38:14.258855 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:38:14.258855 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 12:38:14.258855 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 12:38:14.258855 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:38:14.258855 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:38:14.258855 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:38:14.258855 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:38:14.258855 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 198edd63-e22e-42ca-8c37-89b4f87bab60 could not be found. Jun 16 12:38:14.258855 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:38:14.258855 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:38:14.258855 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:38:14.258855 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:38:14.258855 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:38:14.258855 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:38:14.258855 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:38:14.258855 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:38:14.258855 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 198edd63-e22e-42ca-8c37-89b4f87bab60 could not be found. Jun 16 12:38:14.258855 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:38:14.262061 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2b938c7b-33eb-420b-89e0-482953e48a5d tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Returning 404 to user: Instance 198edd63-e22e-42ca-8c37-89b4f87bab60 could not be found. {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:38:14.262061 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2b938c7b-33eb-420b-89e0-482953e48a5d tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] 10.222.0.45 "GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60" status: 404 len: 111 microversion: 2.1 time: 0.031224 Jun 16 12:38:14.262061 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 537/1065] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:38:14 2022] GET /compute/v2.1/servers/198edd63-e22e-42ca-8c37-89b4f87bab60 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 12:38:14.417438 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-45a5cf34-3172-40ef-8ad2-7fa53bd70abc tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] Calling method '.version_select at 0x7f7c720d1d30>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:38:14.437286 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-45a5cf34-3172-40ef-8ad2-7fa53bd70abc tempest-TestShelveInstance-55869699 tempest-TestShelveInstance-55869699-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1163784128" status: 202 len: 0 microversion: 2.1 time: 0.025076 Jun 16 12:38:14.438362 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 529/1066] 10.222.0.45 () {58 vars in 1253 bytes} [Thu Jun 16 12:38:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1163784128 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 12:38:26.856527 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 12:38:26.857329 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Thu Jun 16 12:38:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 12:38:30.055442 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 12:38:30.056669 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Thu Jun 16 12:38:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 12:38:31.894483 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:38:31.895213 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:38:32.080818 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-9b341f24-ca97-4736-a137-428c1e02b6c8 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Action: 'create', calling method: .version_select at 0x7f7c721c2790>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-176952666", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDXvY4gC89z1HzTiDiZGDnP8aqw9Thho8PMktiti8ySA+w2RzPJVLpB3wgc6kL8XCcayezUcgRug4dYkH/q2VlkciMTr+zqJZFvSsPmarNzZpLkx2dF4+yxzchzglKYvmg=="}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:38:32.107613 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-9b341f24-ca97-4736-a137-428c1e02b6c8 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Getting quotas for project 150f43b9e49a48ee9b72066f07fe95c4. Resources: {'key_pairs'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 12:38:32.111591 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-9b341f24-ca97-4736-a137-428c1e02b6c8 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Getting quotas for user 7cab259dbcb84995aadd366f599afa06 and project 150f43b9e49a48ee9b72066f07fe95c4. Resources: {'key_pairs'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 12:38:32.136193 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-9b341f24-ca97-4736-a137-428c1e02b6c8 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.246668 Jun 16 12:38:32.137039 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 538/1067] 10.222.0.45 () {60 vars in 1158 bytes} [Thu Jun 16 12:38:31 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:39:09.728619 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=10 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:39:09.729363 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:39:09.734052 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-90d77dd1-e381-4043-b514-954fc3a10a43 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-834396887", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-176952666", "security_groups": [{"name": "tempest-secgroup-smoke-766533995"}], "block_device_mapping_v2": [{"uuid": "4938186a-ccf7-4717-b35b-d1c22989176a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "124cf41f-adc1-4007-8672-e5b44992e6b1"}]}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:39:09.848877 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.network.neutron [None req-90d77dd1-e381-4043-b514-954fc3a10a43 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] validate_networks() for [('124cf41f-adc1-4007-8672-e5b44992e6b1', None, None, None, None, None)] {{(pid=117606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 12:39:10.358797 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-90d77dd1-e381-4043-b514-954fc3a10a43 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Flavor limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 12:39:10.359251 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-90d77dd1-e381-4043-b514-954fc3a10a43 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Image limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 12:39:10.360069 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-90d77dd1-e381-4043-b514-954fc3a10a43 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Flavor pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 12:39:10.360720 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-90d77dd1-e381-4043-b514-954fc3a10a43 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Image pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 12:39:10.361352 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-90d77dd1-e381-4043-b514-954fc3a10a43 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 12:39:10.371539 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-90d77dd1-e381-4043-b514-954fc3a10a43 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:39:10.371982 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-90d77dd1-e381-4043-b514-954fc3a10a43 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:39:10.372779 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-90d77dd1-e381-4043-b514-954fc3a10a43 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:39:10.373217 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-90d77dd1-e381-4043-b514-954fc3a10a43 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:39:10.391411 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-90d77dd1-e381-4043-b514-954fc3a10a43 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Getting quotas for project 150f43b9e49a48ee9b72066f07fe95c4. Resources: {'instances', 'cores', 'ram'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 12:39:10.395501 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-90d77dd1-e381-4043-b514-954fc3a10a43 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Getting quotas for user 7cab259dbcb84995aadd366f599afa06 and project 150f43b9e49a48ee9b72066f07fe95c4. Resources: {'instances', 'cores', 'ram'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 12:39:10.457820 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-90d77dd1-e381-4043-b514-954fc3a10a43 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Going to run 1 instances... {{(pid=117606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 12:39:10.459878 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-90d77dd1-e381-4043-b514-954fc3a10a43 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: 59e0a2bf-716d-4e85-8332-f5ca8ffac988] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4938186a-ccf7-4717-b35b-d1c22989176a',volume_size=None,volume_type=None)] {{(pid=117606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 12:39:10.591461 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-90d77dd1-e381-4043-b514-954fc3a10a43 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.864022 Jun 16 12:39:10.597115 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 530/1068] 10.222.0.45 () {60 vars in 1146 bytes} [Thu Jun 16 12:39:09 2022] POST /compute/v2.1/servers => generated 405 bytes in 866 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 12:39:10.600042 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell0:SELECT=4 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:39:10.602093 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:39:10.606982 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-fcbbd554-1981-4ac4-b5b2-7346a7f8e3b3 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:39:10.607603 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-fcbbd554-1981-4ac4-b5b2-7346a7f8e3b3 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: 59e0a2bf-716d-4e85-8332-f5ca8ffac988] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:39:10.667913 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-fcbbd554-1981-4ac4-b5b2-7346a7f8e3b3 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab259dbcb84995aadd366f599afa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150f43b9e49a48ee9b72066f07fe95c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:39:10.675600 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-fcbbd554-1981-4ac4-b5b2-7346a7f8e3b3 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "GET /compute/v2.1/servers/59e0a2bf-716d-4e85-8332-f5ca8ffac988" status: 200 len: 1093 microversion: 2.1 time: 0.077102 Jun 16 12:39:10.676171 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 539/1069] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:39:10 2022] GET /compute/v2.1/servers/59e0a2bf-716d-4e85-8332-f5ca8ffac988 => generated 1093 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:39:11.693230 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-db1ac2a4-64f6-4de6-9ce8-07ae3e37137a tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:39:11.694031 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-db1ac2a4-64f6-4de6-9ce8-07ae3e37137a tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: 59e0a2bf-716d-4e85-8332-f5ca8ffac988] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:39:11.701575 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-db1ac2a4-64f6-4de6-9ce8-07ae3e37137a tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:39:11.702062 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-db1ac2a4-64f6-4de6-9ce8-07ae3e37137a tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:39:11.702833 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-db1ac2a4-64f6-4de6-9ce8-07ae3e37137a tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:39:11.703288 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-db1ac2a4-64f6-4de6-9ce8-07ae3e37137a tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:39:11.794579 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-db1ac2a4-64f6-4de6-9ce8-07ae3e37137a tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab259dbcb84995aadd366f599afa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150f43b9e49a48ee9b72066f07fe95c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:39:11.802224 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-db1ac2a4-64f6-4de6-9ce8-07ae3e37137a tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "GET /compute/v2.1/servers/59e0a2bf-716d-4e85-8332-f5ca8ffac988" status: 200 len: 1199 microversion: 2.1 time: 0.113378 Jun 16 12:39:11.803048 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 531/1070] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:39:11 2022] GET /compute/v2.1/servers/59e0a2bf-716d-4e85-8332-f5ca8ffac988 => generated 1199 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:39:12.820356 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-583f697a-dc87-47af-a13a-c9ca6166604c tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:39:12.820941 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-583f697a-dc87-47af-a13a-c9ca6166604c tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: 59e0a2bf-716d-4e85-8332-f5ca8ffac988] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:39:12.830496 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-583f697a-dc87-47af-a13a-c9ca6166604c tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:39:12.830950 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-583f697a-dc87-47af-a13a-c9ca6166604c tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:39:12.831720 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-583f697a-dc87-47af-a13a-c9ca6166604c tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:39:12.832160 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-583f697a-dc87-47af-a13a-c9ca6166604c tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:39:13.072708 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-583f697a-dc87-47af-a13a-c9ca6166604c tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab259dbcb84995aadd366f599afa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150f43b9e49a48ee9b72066f07fe95c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:39:13.081371 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-583f697a-dc87-47af-a13a-c9ca6166604c tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "GET /compute/v2.1/servers/59e0a2bf-716d-4e85-8332-f5ca8ffac988" status: 200 len: 1264 microversion: 2.1 time: 0.264902 Jun 16 12:39:13.081975 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 540/1071] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:39:12 2022] GET /compute/v2.1/servers/59e0a2bf-716d-4e85-8332-f5ca8ffac988 => generated 1264 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:39:13.233426 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-41165264-244f-487b-a0ef-e09a551cb6fa req-c5def5d8-9547-49a2-a899-f7797a6feef1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59e0a2bf-716d-4e85-8332-f5ca8ffac988", "tag": "02aa5db8-8b4b-41db-8938-d0c9e833052b"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:39:13.247503 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-41165264-244f-487b-a0ef-e09a551cb6fa req-c5def5d8-9547-49a2-a899-f7797a6feef1 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:39:13.247948 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-41165264-244f-487b-a0ef-e09a551cb6fa req-c5def5d8-9547-49a2-a899-f7797a6feef1 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:39:13.260383 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-41165264-244f-487b-a0ef-e09a551cb6fa req-c5def5d8-9547-49a2-a899-f7797a6feef1 service nova] Creating event network-changed:02aa5db8-8b4b-41db-8938-d0c9e833052b for instance 59e0a2bf-716d-4e85-8332-f5ca8ffac988 on hv-cinder-84614 Jun 16 12:39:13.266541 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-41165264-244f-487b-a0ef-e09a551cb6fa req-c5def5d8-9547-49a2-a899-f7797a6feef1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037138 Jun 16 12:39:13.267251 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 532/1072] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:39:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:39:14.099055 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-01bae3ec-693b-4003-8e18-22fc7f0cb477 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:39:14.099668 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-01bae3ec-693b-4003-8e18-22fc7f0cb477 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: 59e0a2bf-716d-4e85-8332-f5ca8ffac988] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:39:14.106918 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-01bae3ec-693b-4003-8e18-22fc7f0cb477 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:39:14.107367 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-01bae3ec-693b-4003-8e18-22fc7f0cb477 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:39:14.108129 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-01bae3ec-693b-4003-8e18-22fc7f0cb477 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:39:14.108571 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-01bae3ec-693b-4003-8e18-22fc7f0cb477 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:39:14.239625 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-01bae3ec-693b-4003-8e18-22fc7f0cb477 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab259dbcb84995aadd366f599afa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150f43b9e49a48ee9b72066f07fe95c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:39:14.247266 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-01bae3ec-693b-4003-8e18-22fc7f0cb477 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "GET /compute/v2.1/servers/59e0a2bf-716d-4e85-8332-f5ca8ffac988" status: 200 len: 1264 microversion: 2.1 time: 0.152202 Jun 16 12:39:14.247830 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 541/1073] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:39:14 2022] GET /compute/v2.1/servers/59e0a2bf-716d-4e85-8332-f5ca8ffac988 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:39:15.264753 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8096e10b-62b5-4ee3-bd1e-e54b3287bb41 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:39:15.265382 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8096e10b-62b5-4ee3-bd1e-e54b3287bb41 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: 59e0a2bf-716d-4e85-8332-f5ca8ffac988] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:39:15.271645 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8096e10b-62b5-4ee3-bd1e-e54b3287bb41 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:39:15.272100 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8096e10b-62b5-4ee3-bd1e-e54b3287bb41 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:39:15.272867 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8096e10b-62b5-4ee3-bd1e-e54b3287bb41 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:39:15.273316 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8096e10b-62b5-4ee3-bd1e-e54b3287bb41 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:39:15.410177 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8096e10b-62b5-4ee3-bd1e-e54b3287bb41 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab259dbcb84995aadd366f599afa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150f43b9e49a48ee9b72066f07fe95c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:39:15.417581 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8096e10b-62b5-4ee3-bd1e-e54b3287bb41 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "GET /compute/v2.1/servers/59e0a2bf-716d-4e85-8332-f5ca8ffac988" status: 200 len: 1264 microversion: 2.1 time: 0.157591 Jun 16 12:39:15.418680 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 533/1074] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:39:15 2022] GET /compute/v2.1/servers/59e0a2bf-716d-4e85-8332-f5ca8ffac988 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:39:16.435341 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0652223c-dce0-431d-84ab-4d2e738fb854 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:39:16.435954 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0652223c-dce0-431d-84ab-4d2e738fb854 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: 59e0a2bf-716d-4e85-8332-f5ca8ffac988] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:39:16.442558 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0652223c-dce0-431d-84ab-4d2e738fb854 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:39:16.443007 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0652223c-dce0-431d-84ab-4d2e738fb854 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:39:16.443766 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0652223c-dce0-431d-84ab-4d2e738fb854 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:39:16.444206 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0652223c-dce0-431d-84ab-4d2e738fb854 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:39:16.577129 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0652223c-dce0-431d-84ab-4d2e738fb854 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab259dbcb84995aadd366f599afa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150f43b9e49a48ee9b72066f07fe95c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:39:16.584891 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0652223c-dce0-431d-84ab-4d2e738fb854 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "GET /compute/v2.1/servers/59e0a2bf-716d-4e85-8332-f5ca8ffac988" status: 200 len: 1264 microversion: 2.1 time: 0.153881 Jun 16 12:39:16.585466 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 542/1075] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:39:16 2022] GET /compute/v2.1/servers/59e0a2bf-716d-4e85-8332-f5ca8ffac988 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:39:17.601013 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-963b5dfd-e6c3-470b-977b-b6ca9b8275a9 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:39:17.601618 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-963b5dfd-e6c3-470b-977b-b6ca9b8275a9 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: 59e0a2bf-716d-4e85-8332-f5ca8ffac988] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:39:17.608732 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-963b5dfd-e6c3-470b-977b-b6ca9b8275a9 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:39:17.609145 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-963b5dfd-e6c3-470b-977b-b6ca9b8275a9 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:39:17.609920 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-963b5dfd-e6c3-470b-977b-b6ca9b8275a9 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:39:17.610397 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-963b5dfd-e6c3-470b-977b-b6ca9b8275a9 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:39:17.742667 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-963b5dfd-e6c3-470b-977b-b6ca9b8275a9 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab259dbcb84995aadd366f599afa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150f43b9e49a48ee9b72066f07fe95c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:39:17.751401 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-963b5dfd-e6c3-470b-977b-b6ca9b8275a9 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "GET /compute/v2.1/servers/59e0a2bf-716d-4e85-8332-f5ca8ffac988" status: 200 len: 1264 microversion: 2.1 time: 0.154227 Jun 16 12:39:17.751965 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 534/1076] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:39:17 2022] GET /compute/v2.1/servers/59e0a2bf-716d-4e85-8332-f5ca8ffac988 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:39:18.767585 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-841d723f-5b71-42c8-a15e-2974dedf38d2 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:39:18.768180 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-841d723f-5b71-42c8-a15e-2974dedf38d2 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: 59e0a2bf-716d-4e85-8332-f5ca8ffac988] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:39:18.774688 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-841d723f-5b71-42c8-a15e-2974dedf38d2 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:39:18.775141 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-841d723f-5b71-42c8-a15e-2974dedf38d2 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:39:18.776171 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-841d723f-5b71-42c8-a15e-2974dedf38d2 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:39:18.776607 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-841d723f-5b71-42c8-a15e-2974dedf38d2 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:39:18.905665 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-841d723f-5b71-42c8-a15e-2974dedf38d2 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab259dbcb84995aadd366f599afa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150f43b9e49a48ee9b72066f07fe95c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:39:18.913150 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-841d723f-5b71-42c8-a15e-2974dedf38d2 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "GET /compute/v2.1/servers/59e0a2bf-716d-4e85-8332-f5ca8ffac988" status: 200 len: 1264 microversion: 2.1 time: 0.149450 Jun 16 12:39:18.913711 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 543/1077] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:39:18 2022] GET /compute/v2.1/servers/59e0a2bf-716d-4e85-8332-f5ca8ffac988 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:39:19.930604 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6a248739-0974-426d-9b61-cf7ed359e99a tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:39:19.931464 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6a248739-0974-426d-9b61-cf7ed359e99a tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: 59e0a2bf-716d-4e85-8332-f5ca8ffac988] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:39:19.939094 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6a248739-0974-426d-9b61-cf7ed359e99a tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:39:19.939540 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6a248739-0974-426d-9b61-cf7ed359e99a tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:39:19.940289 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6a248739-0974-426d-9b61-cf7ed359e99a tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:39:19.940724 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6a248739-0974-426d-9b61-cf7ed359e99a tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:39:20.073426 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6a248739-0974-426d-9b61-cf7ed359e99a tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab259dbcb84995aadd366f599afa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150f43b9e49a48ee9b72066f07fe95c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:39:20.081334 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6a248739-0974-426d-9b61-cf7ed359e99a tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "GET /compute/v2.1/servers/59e0a2bf-716d-4e85-8332-f5ca8ffac988" status: 200 len: 1264 microversion: 2.1 time: 0.154614 Jun 16 12:39:20.081903 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 535/1078] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:39:19 2022] GET /compute/v2.1/servers/59e0a2bf-716d-4e85-8332-f5ca8ffac988 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:39:21.098534 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-682b3aeb-2b48-4e8b-af70-6a278a75c2fb tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:39:21.099261 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-682b3aeb-2b48-4e8b-af70-6a278a75c2fb tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: 59e0a2bf-716d-4e85-8332-f5ca8ffac988] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:39:21.101710 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell0:SELECT=2 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:39:21.109251 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-682b3aeb-2b48-4e8b-af70-6a278a75c2fb tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:39:21.109858 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-682b3aeb-2b48-4e8b-af70-6a278a75c2fb tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:39:21.110784 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-682b3aeb-2b48-4e8b-af70-6a278a75c2fb tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:39:21.111252 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-682b3aeb-2b48-4e8b-af70-6a278a75c2fb tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:39:21.242785 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-682b3aeb-2b48-4e8b-af70-6a278a75c2fb tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab259dbcb84995aadd366f599afa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150f43b9e49a48ee9b72066f07fe95c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:39:21.250406 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-682b3aeb-2b48-4e8b-af70-6a278a75c2fb tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "GET /compute/v2.1/servers/59e0a2bf-716d-4e85-8332-f5ca8ffac988" status: 200 len: 1264 microversion: 2.1 time: 0.155722 Jun 16 12:39:21.250884 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 544/1079] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:39:21 2022] GET /compute/v2.1/servers/59e0a2bf-716d-4e85-8332-f5ca8ffac988 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:39:22.267648 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-180188eb-b055-48e3-9eb8-16d81b218270 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:39:22.268637 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-180188eb-b055-48e3-9eb8-16d81b218270 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: 59e0a2bf-716d-4e85-8332-f5ca8ffac988] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:39:22.270441 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=2 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:39:22.271112 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=6 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:39:22.278509 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-180188eb-b055-48e3-9eb8-16d81b218270 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:39:22.278959 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-180188eb-b055-48e3-9eb8-16d81b218270 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:39:22.279731 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-180188eb-b055-48e3-9eb8-16d81b218270 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:39:22.280174 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-180188eb-b055-48e3-9eb8-16d81b218270 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:39:22.409960 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-180188eb-b055-48e3-9eb8-16d81b218270 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab259dbcb84995aadd366f599afa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150f43b9e49a48ee9b72066f07fe95c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:39:22.417349 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-180188eb-b055-48e3-9eb8-16d81b218270 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "GET /compute/v2.1/servers/59e0a2bf-716d-4e85-8332-f5ca8ffac988" status: 200 len: 1264 microversion: 2.1 time: 0.153539 Jun 16 12:39:22.417924 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 536/1080] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:39:22 2022] GET /compute/v2.1/servers/59e0a2bf-716d-4e85-8332-f5ca8ffac988 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:39:23.140335 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-f79c2045-b6d6-4396-8951-f8a8c0c06273 req-36907acd-0785-4ff5-b67b-63b0d14a2ea6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59e0a2bf-716d-4e85-8332-f5ca8ffac988", "name": "network-vif-plugged", "status": "completed", "tag": "02aa5db8-8b4b-41db-8938-d0c9e833052b"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:39:23.148383 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-f79c2045-b6d6-4396-8951-f8a8c0c06273 req-36907acd-0785-4ff5-b67b-63b0d14a2ea6 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:39:23.148832 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-f79c2045-b6d6-4396-8951-f8a8c0c06273 req-36907acd-0785-4ff5-b67b-63b0d14a2ea6 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:39:23.159827 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-f79c2045-b6d6-4396-8951-f8a8c0c06273 req-36907acd-0785-4ff5-b67b-63b0d14a2ea6 service nova] Creating event network-vif-plugged:02aa5db8-8b4b-41db-8938-d0c9e833052b for instance 59e0a2bf-716d-4e85-8332-f5ca8ffac988 on hv-cinder-84614 Jun 16 12:39:23.164843 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-f79c2045-b6d6-4396-8951-f8a8c0c06273 req-36907acd-0785-4ff5-b67b-63b0d14a2ea6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.205839 Jun 16 12:39:23.165423 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 545/1081] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:39:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:39:23.434190 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fe843f02-5bca-4ca9-be69-29559eb6ecc1 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:39:23.434948 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-fe843f02-5bca-4ca9-be69-29559eb6ecc1 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: 59e0a2bf-716d-4e85-8332-f5ca8ffac988] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:39:23.441411 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fe843f02-5bca-4ca9-be69-29559eb6ecc1 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:39:23.441862 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fe843f02-5bca-4ca9-be69-29559eb6ecc1 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:39:23.442851 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fe843f02-5bca-4ca9-be69-29559eb6ecc1 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:39:23.443298 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fe843f02-5bca-4ca9-be69-29559eb6ecc1 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:39:23.572199 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fe843f02-5bca-4ca9-be69-29559eb6ecc1 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab259dbcb84995aadd366f599afa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150f43b9e49a48ee9b72066f07fe95c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:39:23.580281 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-fe843f02-5bca-4ca9-be69-29559eb6ecc1 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "GET /compute/v2.1/servers/59e0a2bf-716d-4e85-8332-f5ca8ffac988" status: 200 len: 1264 microversion: 2.1 time: 0.150122 Jun 16 12:39:23.580846 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 537/1082] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:39:23 2022] GET /compute/v2.1/servers/59e0a2bf-716d-4e85-8332-f5ca8ffac988 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:39:24.597623 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-9ae62c16-b14c-44c5-9d01-d33faadfef4d tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:39:24.598261 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-9ae62c16-b14c-44c5-9d01-d33faadfef4d tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: 59e0a2bf-716d-4e85-8332-f5ca8ffac988] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:39:24.604546 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9ae62c16-b14c-44c5-9d01-d33faadfef4d tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:39:24.605142 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9ae62c16-b14c-44c5-9d01-d33faadfef4d tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:39:24.606954 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9ae62c16-b14c-44c5-9d01-d33faadfef4d tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:39:24.607394 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9ae62c16-b14c-44c5-9d01-d33faadfef4d tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:39:24.742518 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-9ae62c16-b14c-44c5-9d01-d33faadfef4d tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab259dbcb84995aadd366f599afa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150f43b9e49a48ee9b72066f07fe95c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:39:24.750007 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-9ae62c16-b14c-44c5-9d01-d33faadfef4d tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "GET /compute/v2.1/servers/59e0a2bf-716d-4e85-8332-f5ca8ffac988" status: 200 len: 1264 microversion: 2.1 time: 0.157076 Jun 16 12:39:24.750567 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 546/1083] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:39:24 2022] GET /compute/v2.1/servers/59e0a2bf-716d-4e85-8332-f5ca8ffac988 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:39:25.767342 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-25a8441c-23f1-40d9-94cd-6dffbebf971f tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:39:25.767981 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-25a8441c-23f1-40d9-94cd-6dffbebf971f tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: 59e0a2bf-716d-4e85-8332-f5ca8ffac988] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:39:25.774476 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-25a8441c-23f1-40d9-94cd-6dffbebf971f tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:39:25.774923 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-25a8441c-23f1-40d9-94cd-6dffbebf971f tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:39:25.775940 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-25a8441c-23f1-40d9-94cd-6dffbebf971f tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:39:25.776371 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-25a8441c-23f1-40d9-94cd-6dffbebf971f tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:39:25.906531 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-25a8441c-23f1-40d9-94cd-6dffbebf971f tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab259dbcb84995aadd366f599afa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150f43b9e49a48ee9b72066f07fe95c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:39:25.913890 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-25a8441c-23f1-40d9-94cd-6dffbebf971f tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "GET /compute/v2.1/servers/59e0a2bf-716d-4e85-8332-f5ca8ffac988" status: 200 len: 1451 microversion: 2.1 time: 0.150647 Jun 16 12:39:25.914459 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 538/1084] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:39:25 2022] GET /compute/v2.1/servers/59e0a2bf-716d-4e85-8332-f5ca8ffac988 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:39:25.930711 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b4d26253-dd94-4605-ba23-7756a2ba4084 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:39:25.931329 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b4d26253-dd94-4605-ba23-7756a2ba4084 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: 59e0a2bf-716d-4e85-8332-f5ca8ffac988] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:39:25.938458 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b4d26253-dd94-4605-ba23-7756a2ba4084 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:39:25.938936 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b4d26253-dd94-4605-ba23-7756a2ba4084 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:39:25.939675 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b4d26253-dd94-4605-ba23-7756a2ba4084 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:39:25.940114 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b4d26253-dd94-4605-ba23-7756a2ba4084 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:39:26.070116 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b4d26253-dd94-4605-ba23-7756a2ba4084 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab259dbcb84995aadd366f599afa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150f43b9e49a48ee9b72066f07fe95c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:39:26.077582 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b4d26253-dd94-4605-ba23-7756a2ba4084 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "GET /compute/v2.1/servers/59e0a2bf-716d-4e85-8332-f5ca8ffac988" status: 200 len: 1451 microversion: 2.1 time: 0.150772 Jun 16 12:39:26.078188 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 547/1085] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:39:25 2022] GET /compute/v2.1/servers/59e0a2bf-716d-4e85-8332-f5ca8ffac988 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:39:28.038872 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-020c98b6-8d01-4643-bcab-22eb8221736c req-6aafe344-548c-430b-a9ec-8d43e334c85e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59e0a2bf-716d-4e85-8332-f5ca8ffac988", "tag": "02aa5db8-8b4b-41db-8938-d0c9e833052b"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:39:28.047315 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-020c98b6-8d01-4643-bcab-22eb8221736c req-6aafe344-548c-430b-a9ec-8d43e334c85e service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:39:28.047771 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-020c98b6-8d01-4643-bcab-22eb8221736c req-6aafe344-548c-430b-a9ec-8d43e334c85e service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:39:28.058471 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-020c98b6-8d01-4643-bcab-22eb8221736c req-6aafe344-548c-430b-a9ec-8d43e334c85e service nova] Creating event network-changed:02aa5db8-8b4b-41db-8938-d0c9e833052b for instance 59e0a2bf-716d-4e85-8332-f5ca8ffac988 on hv-cinder-84614 Jun 16 12:39:28.064236 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-020c98b6-8d01-4643-bcab-22eb8221736c req-6aafe344-548c-430b-a9ec-8d43e334c85e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028669 Jun 16 12:39:28.065101 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 539/1086] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:39:29.446309 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-35c85447-35f2-489b-94da-e02c3e4501d1 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:39:29.447241 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-35c85447-35f2-489b-94da-e02c3e4501d1 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: 8e91b2d7-1250-4cca-965d-c18107d8c3a1] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:39:29.453730 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-35c85447-35f2-489b-94da-e02c3e4501d1 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:39:29.454222 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-35c85447-35f2-489b-94da-e02c3e4501d1 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:39:29.454990 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-35c85447-35f2-489b-94da-e02c3e4501d1 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:39:29.455430 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-35c85447-35f2-489b-94da-e02c3e4501d1 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:39:29.484752 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-35c85447-35f2-489b-94da-e02c3e4501d1 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042470 Jun 16 12:39:29.485300 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 548/1087] 10.222.0.45 () {58 vars in 1301 bytes} [Thu Jun 16 12:39:29 2022] GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 12:39:29.544012 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4910e07d-dc1f-485d-b1e3-cb111f7dbc31 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:39:29.544598 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4910e07d-dc1f-485d-b1e3-cb111f7dbc31 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: 8e91b2d7-1250-4cca-965d-c18107d8c3a1] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:39:29.551249 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4910e07d-dc1f-485d-b1e3-cb111f7dbc31 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:39:29.551703 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4910e07d-dc1f-485d-b1e3-cb111f7dbc31 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:39:29.552462 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4910e07d-dc1f-485d-b1e3-cb111f7dbc31 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:39:29.552901 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4910e07d-dc1f-485d-b1e3-cb111f7dbc31 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:39:29.579322 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4910e07d-dc1f-485d-b1e3-cb111f7dbc31 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: 8e91b2d7-1250-4cca-965d-c18107d8c3a1] Going to try to terminate instance {{(pid=117606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 12:39:29.654195 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4910e07d-dc1f-485d-b1e3-cb111f7dbc31 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "DELETE /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1" status: 204 len: 0 microversion: 2.1 time: 0.113845 Jun 16 12:39:29.654689 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 540/1088] 10.222.0.45 () {58 vars in 1238 bytes} [Thu Jun 16 12:39:29 2022] DELETE /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 12:39:29.662776 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a0ef9b6c-6974-4a96-adfa-2a662012d805 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:39:29.663470 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a0ef9b6c-6974-4a96-adfa-2a662012d805 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: 8e91b2d7-1250-4cca-965d-c18107d8c3a1] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:39:29.670246 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a0ef9b6c-6974-4a96-adfa-2a662012d805 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:39:29.670703 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a0ef9b6c-6974-4a96-adfa-2a662012d805 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:39:29.671471 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a0ef9b6c-6974-4a96-adfa-2a662012d805 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:39:29.671918 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a0ef9b6c-6974-4a96-adfa-2a662012d805 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:39:29.799491 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a0ef9b6c-6974-4a96-adfa-2a662012d805 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e53fdd4ca2b4fd8b64caea6924fa969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb62ca3babf9402996e0ef47fc0d8e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:39:29.806893 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a0ef9b6c-6974-4a96-adfa-2a662012d805 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1" status: 200 len: 1672 microversion: 2.1 time: 0.147972 Jun 16 12:39:29.807464 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 549/1089] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:39:29 2022] GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1 => generated 1672 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:39:30.825740 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-bae93e1c-6d48-49d9-8cd4-51f03bcbd6f7 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:39:30.826481 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-bae93e1c-6d48-49d9-8cd4-51f03bcbd6f7 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: 8e91b2d7-1250-4cca-965d-c18107d8c3a1] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:39:30.832877 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bae93e1c-6d48-49d9-8cd4-51f03bcbd6f7 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:39:30.833316 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bae93e1c-6d48-49d9-8cd4-51f03bcbd6f7 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:39:30.834141 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bae93e1c-6d48-49d9-8cd4-51f03bcbd6f7 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:39:30.834566 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bae93e1c-6d48-49d9-8cd4-51f03bcbd6f7 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:39:30.966580 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-bae93e1c-6d48-49d9-8cd4-51f03bcbd6f7 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e53fdd4ca2b4fd8b64caea6924fa969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb62ca3babf9402996e0ef47fc0d8e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:39:30.973920 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-bae93e1c-6d48-49d9-8cd4-51f03bcbd6f7 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1" status: 200 len: 1672 microversion: 2.1 time: 0.152808 Jun 16 12:39:30.974474 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 541/1090] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:39:30 2022] GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1 => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:39:32.094241 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3e0bb058-65bf-4cf7-bc59-8e6dac0cf161 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:39:32.095004 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3e0bb058-65bf-4cf7-bc59-8e6dac0cf161 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: 8e91b2d7-1250-4cca-965d-c18107d8c3a1] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:39:32.101080 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3e0bb058-65bf-4cf7-bc59-8e6dac0cf161 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:39:32.101530 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3e0bb058-65bf-4cf7-bc59-8e6dac0cf161 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:39:32.102333 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3e0bb058-65bf-4cf7-bc59-8e6dac0cf161 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:39:32.102771 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3e0bb058-65bf-4cf7-bc59-8e6dac0cf161 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:39:32.326406 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-3e0bb058-65bf-4cf7-bc59-8e6dac0cf161 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e53fdd4ca2b4fd8b64caea6924fa969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb62ca3babf9402996e0ef47fc0d8e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:39:32.334373 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3e0bb058-65bf-4cf7-bc59-8e6dac0cf161 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1" status: 200 len: 1672 microversion: 2.1 time: 0.346246 Jun 16 12:39:32.334953 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 550/1091] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:39:31 2022] GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1 => generated 1672 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:39:32.986349 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-9207bdbf-fb79-49b6-8397-e2dcf57b0cab req-c238f6e0-2d4c-4ea4-ae87-373c94042914 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e91b2d7-1250-4cca-965d-c18107d8c3a1", "name": "network-vif-deleted", "tag": "6254bf02-1e64-4fb2-a1b4-c3f29dd8e87a"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:39:32.997347 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-9207bdbf-fb79-49b6-8397-e2dcf57b0cab req-c238f6e0-2d4c-4ea4-ae87-373c94042914 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:39:32.997719 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-9207bdbf-fb79-49b6-8397-e2dcf57b0cab req-c238f6e0-2d4c-4ea4-ae87-373c94042914 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:39:33.009850 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-9207bdbf-fb79-49b6-8397-e2dcf57b0cab req-c238f6e0-2d4c-4ea4-ae87-373c94042914 service nova] Creating event network-vif-deleted:6254bf02-1e64-4fb2-a1b4-c3f29dd8e87a for instance 8e91b2d7-1250-4cca-965d-c18107d8c3a1 on hv-cinder-84614 Jun 16 12:39:33.016360 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-9207bdbf-fb79-49b6-8397-e2dcf57b0cab req-c238f6e0-2d4c-4ea4-ae87-373c94042914 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033992 Jun 16 12:39:33.017215 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 542/1092] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:39:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:39:33.361407 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ff655326-b0f5-43fe-8f9b-c6c3c79c2a8e tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:39:33.362037 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ff655326-b0f5-43fe-8f9b-c6c3c79c2a8e tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: 8e91b2d7-1250-4cca-965d-c18107d8c3a1] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:39:33.368284 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ff655326-b0f5-43fe-8f9b-c6c3c79c2a8e tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:39:33.368732 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ff655326-b0f5-43fe-8f9b-c6c3c79c2a8e tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:39:33.369494 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ff655326-b0f5-43fe-8f9b-c6c3c79c2a8e tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:39:33.369949 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ff655326-b0f5-43fe-8f9b-c6c3c79c2a8e tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:39:33.402474 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ff655326-b0f5-43fe-8f9b-c6c3c79c2a8e tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:39:33.403162 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ff655326-b0f5-43fe-8f9b-c6c3c79c2a8e tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:39:33.403807 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.objects.instance [None req-ff655326-b0f5-43fe-8f9b-c6c3c79c2a8e tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lazy-loading 'fault' on Instance uuid 8e91b2d7-1250-4cca-965d-c18107d8c3a1 {{(pid=117607) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 12:39:33.447744 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ff655326-b0f5-43fe-8f9b-c6c3c79c2a8e tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e53fdd4ca2b4fd8b64caea6924fa969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb62ca3babf9402996e0ef47fc0d8e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:39:33.456443 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ff655326-b0f5-43fe-8f9b-c6c3c79c2a8e tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1" status: 200 len: 1326 microversion: 2.1 time: 0.107836 Jun 16 12:39:33.457222 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 551/1093] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:39:33 2022] GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1 => generated 1326 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:39:34.474586 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-591be872-041d-46b2-a089-c548f97df011 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:39:34.475285 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-591be872-041d-46b2-a089-c548f97df011 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: 8e91b2d7-1250-4cca-965d-c18107d8c3a1] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:39:34.482655 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-591be872-041d-46b2-a089-c548f97df011 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:39:34.483104 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-591be872-041d-46b2-a089-c548f97df011 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:39:34.483856 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-591be872-041d-46b2-a089-c548f97df011 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:39:34.484293 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-591be872-041d-46b2-a089-c548f97df011 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:39:34.497641 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-591be872-041d-46b2-a089-c548f97df011 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] HTTP exception thrown: Instance 8e91b2d7-1250-4cca-965d-c18107d8c3a1 could not be found. Jun 16 12:39:34.499269 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-591be872-041d-46b2-a089-c548f97df011 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Request method failure captured: Jun 16 12:39:34.499269 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: request: GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1 HTTP/1.1 Jun 16 12:39:34.499269 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 16 12:39:34.499269 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 16 12:39:34.499269 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Connection: close Jun 16 12:39:34.499269 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 16 12:39:34.499269 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 16 12:39:34.499269 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Host: 10.222.0.45 Jun 16 12:39:34.499269 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 16 12:39:34.499269 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 16 12:39:34.499269 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABiqyNXlybMpWRuddoduOrNogIVdUlE_kj6OPm37PeG33-vpWOxd1JWof2ZCUk8ebzvPHBQ02Y2oDvYk1GCsU-8iPo_IE7Le4k3HG-hymCiPmjgBkvr0TbsO4Tj01mZyVYRgDplCaD-jIgvgAjSJEajM_Q5CtIxDtk5cxQvKbuJZ8Nb_tM Jun 16 12:39:34.499269 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 16 12:39:34.499269 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 16 12:39:34.499269 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 16 12:39:34.499269 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 16 12:39:34.499269 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 16 12:39:34.499269 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 16 12:39:34.499269 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Id: eb62ca3babf9402996e0ef47fc0d8e81 Jun 16 12:39:34.499269 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-AttachVolumeTestJSON-501064817 Jun 16 12:39:34.499269 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 16 12:39:34.499269 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 16 12:39:34.501031 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/eb62ca3babf9402996e0ef47fc0d8e81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/eb62ca3babf9402996e0ef47fc0d8e81"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_eb62ca3babf9402996e0ef47fc0d8e81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/eb62ca3babf9402996e0ef47fc0d8e81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Jun 16 12:39:34.501031 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-AttachVolumeTestJSON-501064817 Jun 16 12:39:34.501031 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant-Id: eb62ca3babf9402996e0ef47fc0d8e81 Jun 16 12:39:34.501031 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-AttachVolumeTestJSON-501064817 Jun 16 12:39:34.501031 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User: tempest-AttachVolumeTestJSON-501064817-project Jun 16 12:39:34.501031 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 16 12:39:34.501031 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 16 12:39:34.501031 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Id: 1e53fdd4ca2b4fd8b64caea6924fa969 Jun 16 12:39:34.501031 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-AttachVolumeTestJSON-501064817-project Jun 16 12:39:34.501031 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: method: > Jun 16 12:39:34.501031 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: exception: Instance 8e91b2d7-1250-4cca-965d-c18107d8c3a1 could not be found. Jun 16 12:39:34.501031 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: action_args: {'id': '8e91b2d7-1250-4cca-965d-c18107d8c3a1'} Jun 16 12:39:34.502154 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:39:34.502154 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:39:34.502154 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:39:34.502154 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:39:34.502154 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:39:34.502154 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:39:34.502154 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:39:34.502154 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:39:34.502154 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:39:34.502154 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:39:34.502154 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e91b2d7-1250-4cca-965d-c18107d8c3a1 could not be found. Jun 16 12:39:34.502154 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:39:34.502154 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:39:34.502154 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:39:34.502154 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:39:34.502154 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:39:34.502154 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:39:34.502154 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:39:34.502154 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:39:34.502154 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:39:34.503776 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:39:34.503776 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 12:39:34.503776 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 12:39:34.503776 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:39:34.503776 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:39:34.503776 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:39:34.503776 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:39:34.503776 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e91b2d7-1250-4cca-965d-c18107d8c3a1 could not be found. Jun 16 12:39:34.503776 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:39:34.503776 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:39:34.503776 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:39:34.503776 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:39:34.503776 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:39:34.503776 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:39:34.503776 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:39:34.503776 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:39:34.503776 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e91b2d7-1250-4cca-965d-c18107d8c3a1 could not be found. Jun 16 12:39:34.503776 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:39:34.505217 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-591be872-041d-46b2-a089-c548f97df011 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Returning 404 to user: Instance 8e91b2d7-1250-4cca-965d-c18107d8c3a1 could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:39:34.505217 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-591be872-041d-46b2-a089-c548f97df011 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1" status: 404 len: 111 microversion: 2.1 time: 0.030205 Jun 16 12:39:34.505217 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 543/1094] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:39:34 2022] GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 12:39:34.509255 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0fccd66e-0285-4a51-9259-d9d651c7b7d3 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '.version_select at 0x7f7c721c24c0>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:39:34.526854 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0fccd66e-0285-4a51-9259-d9d651c7b7d3 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-66845392" status: 202 len: 0 microversion: 2.1 time: 0.021241 Jun 16 12:39:34.527412 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 552/1095] 10.222.0.45 () {58 vars in 1214 bytes} [Thu Jun 16 12:39:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-66845392 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 12:39:35.138515 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-eae531f0-4826-43c1-b9fb-0bd58de89cb3 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Action: 'create', calling method: .version_select at 0x7f7c7201ec10>, body: {"keypair": {"name": "tempest-keypair-382349755", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8RfulDzwCMZDXOl6Sblecmc5yW5qL2QrU0oLQ47+6+3HWkW4ve8s44SwEImknkTM7WI4PJLpbi3xXxwZQnTlUEViZLFXTNuWFEhDnzuhDdE5dc+MGbCHZ7mkFFvOla2A=="}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:39:35.152456 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-eae531f0-4826-43c1-b9fb-0bd58de89cb3 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Getting quotas for project eb62ca3babf9402996e0ef47fc0d8e81. Resources: {'key_pairs'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 12:39:35.156965 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-eae531f0-4826-43c1-b9fb-0bd58de89cb3 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Getting quotas for user 1e53fdd4ca2b4fd8b64caea6924fa969 and project eb62ca3babf9402996e0ef47fc0d8e81. Resources: {'key_pairs'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 12:39:35.178337 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-eae531f0-4826-43c1-b9fb-0bd58de89cb3 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044431 Jun 16 12:39:35.178916 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 544/1096] 10.222.0.45 () {60 vars in 1158 bytes} [Thu Jun 16 12:39:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:39:36.392359 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5a664238-3875-490c-8035-64e07f7cb3f2 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-613676844", "imageRef": "c736a2d2-9d0d-41ec-b9fc-971428b0ff7a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "22375b03-63d5-499f-a2ff-ecb7b82e8fd4"}], "security_groups": [{"name": "tempest-securitygroup--446471294"}], "key_name": "tempest-keypair-382349755", "user_data": "}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:39:36.493108 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.network.neutron [None req-5a664238-3875-490c-8035-64e07f7cb3f2 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] validate_networks() for [('22375b03-63d5-499f-a2ff-ecb7b82e8fd4', None, None, None, None, None)] {{(pid=117607) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 12:39:37.175245 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-5a664238-3875-490c-8035-64e07f7cb3f2 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Flavor limits 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 12:39:37.175679 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-5a664238-3875-490c-8035-64e07f7cb3f2 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Image limits 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 12:39:37.176157 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-5a664238-3875-490c-8035-64e07f7cb3f2 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Flavor pref 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 12:39:37.176572 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-5a664238-3875-490c-8035-64e07f7cb3f2 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Image pref 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 12:39:37.176998 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-5a664238-3875-490c-8035-64e07f7cb3f2 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 12:39:37.186130 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5a664238-3875-490c-8035-64e07f7cb3f2 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:39:37.186582 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5a664238-3875-490c-8035-64e07f7cb3f2 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:39:37.187403 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5a664238-3875-490c-8035-64e07f7cb3f2 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:39:37.187844 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5a664238-3875-490c-8035-64e07f7cb3f2 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:39:37.204795 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-5a664238-3875-490c-8035-64e07f7cb3f2 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Getting quotas for project eb62ca3babf9402996e0ef47fc0d8e81. Resources: {'instances', 'cores', 'ram'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 12:39:37.208777 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-5a664238-3875-490c-8035-64e07f7cb3f2 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Getting quotas for user 1e53fdd4ca2b4fd8b64caea6924fa969 and project eb62ca3babf9402996e0ef47fc0d8e81. Resources: {'instances', 'cores', 'ram'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 12:39:37.220130 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5a664238-3875-490c-8035-64e07f7cb3f2 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Going to run 1 instances... {{(pid=117607) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 12:39:37.222386 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5a664238-3875-490c-8035-64e07f7cb3f2 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: d137a37f-fa39-42ba-ab8d-b0168a8eeb26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c736a2d2-9d0d-41ec-b9fc-971428b0ff7a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117607) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 12:39:37.270221 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5a664238-3875-490c-8035-64e07f7cb3f2 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.883314 Jun 16 12:39:37.270904 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 553/1097] 10.222.0.45 () {60 vars in 1146 bytes} [Thu Jun 16 12:39:36 2022] POST /compute/v2.1/servers => generated 401 bytes in 885 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 12:39:37.282031 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-91e3635f-58ed-4d34-9aa0-d519ac708e9d tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:39:37.282735 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-91e3635f-58ed-4d34-9aa0-d519ac708e9d tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: d137a37f-fa39-42ba-ab8d-b0168a8eeb26] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:39:37.337178 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-91e3635f-58ed-4d34-9aa0-d519ac708e9d tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e53fdd4ca2b4fd8b64caea6924fa969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb62ca3babf9402996e0ef47fc0d8e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:39:37.344590 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-91e3635f-58ed-4d34-9aa0-d519ac708e9d tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "GET /compute/v2.1/servers/d137a37f-fa39-42ba-ab8d-b0168a8eeb26" status: 200 len: 1236 microversion: 2.1 time: 0.067439 Jun 16 12:39:37.345178 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 545/1098] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:39:37 2022] GET /compute/v2.1/servers/d137a37f-fa39-42ba-ab8d-b0168a8eeb26 => generated 1236 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:39:38.368223 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-821b2bd6-05c9-490c-8f96-9e85f5e5f646 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:39:38.368864 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-821b2bd6-05c9-490c-8f96-9e85f5e5f646 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: d137a37f-fa39-42ba-ab8d-b0168a8eeb26] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:39:38.376244 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-821b2bd6-05c9-490c-8f96-9e85f5e5f646 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:39:38.376700 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-821b2bd6-05c9-490c-8f96-9e85f5e5f646 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:39:38.377483 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-821b2bd6-05c9-490c-8f96-9e85f5e5f646 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:39:38.377956 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-821b2bd6-05c9-490c-8f96-9e85f5e5f646 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:39:38.445997 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-821b2bd6-05c9-490c-8f96-9e85f5e5f646 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e53fdd4ca2b4fd8b64caea6924fa969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb62ca3babf9402996e0ef47fc0d8e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:39:38.453441 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-821b2bd6-05c9-490c-8f96-9e85f5e5f646 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "GET /compute/v2.1/servers/d137a37f-fa39-42ba-ab8d-b0168a8eeb26" status: 200 len: 1294 microversion: 2.1 time: 0.090902 Jun 16 12:39:38.454029 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 554/1099] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:39:38 2022] GET /compute/v2.1/servers/d137a37f-fa39-42ba-ab8d-b0168a8eeb26 => generated 1294 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:39:39.471542 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0e0888c8-3160-44d3-9335-60646a94ebe4 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:39:39.472159 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0e0888c8-3160-44d3-9335-60646a94ebe4 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: d137a37f-fa39-42ba-ab8d-b0168a8eeb26] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:39:39.479128 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0e0888c8-3160-44d3-9335-60646a94ebe4 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:39:39.479470 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0e0888c8-3160-44d3-9335-60646a94ebe4 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:39:39.480245 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0e0888c8-3160-44d3-9335-60646a94ebe4 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:39:39.481687 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0e0888c8-3160-44d3-9335-60646a94ebe4 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:39:39.670121 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0e0888c8-3160-44d3-9335-60646a94ebe4 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e53fdd4ca2b4fd8b64caea6924fa969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb62ca3babf9402996e0ef47fc0d8e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:39:39.677537 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0e0888c8-3160-44d3-9335-60646a94ebe4 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "GET /compute/v2.1/servers/d137a37f-fa39-42ba-ab8d-b0168a8eeb26" status: 200 len: 1361 microversion: 2.1 time: 0.209891 Jun 16 12:39:39.678560 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 546/1100] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:39:39 2022] GET /compute/v2.1/servers/d137a37f-fa39-42ba-ab8d-b0168a8eeb26 => generated 1361 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:39:39.737277 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-bf1843bc-8c2e-43df-a859-11a983e08504 req-185da622-4a01-4b0e-8b7f-6c05de6272e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d137a37f-fa39-42ba-ab8d-b0168a8eeb26", "tag": "6b2a3cde-71be-4d17-b027-059d51f5cd96"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:39:39.752079 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-bf1843bc-8c2e-43df-a859-11a983e08504 req-185da622-4a01-4b0e-8b7f-6c05de6272e4 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:39:39.753464 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-bf1843bc-8c2e-43df-a859-11a983e08504 req-185da622-4a01-4b0e-8b7f-6c05de6272e4 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:39:39.769906 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-bf1843bc-8c2e-43df-a859-11a983e08504 req-185da622-4a01-4b0e-8b7f-6c05de6272e4 service nova] Creating event network-changed:6b2a3cde-71be-4d17-b027-059d51f5cd96 for instance d137a37f-fa39-42ba-ab8d-b0168a8eeb26 on hv-cinder-84614 Jun 16 12:39:39.776575 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-bf1843bc-8c2e-43df-a859-11a983e08504 req-185da622-4a01-4b0e-8b7f-6c05de6272e4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045645 Jun 16 12:39:39.777182 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 555/1101] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:39:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:39:40.696306 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a67d853c-8ed3-4b00-9ef6-f23b5bdf2411 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:39:40.696918 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a67d853c-8ed3-4b00-9ef6-f23b5bdf2411 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: d137a37f-fa39-42ba-ab8d-b0168a8eeb26] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:39:40.699415 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:39:40.705618 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a67d853c-8ed3-4b00-9ef6-f23b5bdf2411 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:39:40.706092 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a67d853c-8ed3-4b00-9ef6-f23b5bdf2411 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:39:40.706854 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a67d853c-8ed3-4b00-9ef6-f23b5bdf2411 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:39:40.707322 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a67d853c-8ed3-4b00-9ef6-f23b5bdf2411 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:39:40.711019 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:39:40.844398 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a67d853c-8ed3-4b00-9ef6-f23b5bdf2411 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e53fdd4ca2b4fd8b64caea6924fa969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb62ca3babf9402996e0ef47fc0d8e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:39:40.852064 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a67d853c-8ed3-4b00-9ef6-f23b5bdf2411 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "GET /compute/v2.1/servers/d137a37f-fa39-42ba-ab8d-b0168a8eeb26" status: 200 len: 1361 microversion: 2.1 time: 0.159644 Jun 16 12:39:40.852635 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 547/1102] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:39:40 2022] GET /compute/v2.1/servers/d137a37f-fa39-42ba-ab8d-b0168a8eeb26 => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:39:41.869437 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-997ab67c-c049-4292-b217-2f2b7d7c5956 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:39:41.870193 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-997ab67c-c049-4292-b217-2f2b7d7c5956 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: d137a37f-fa39-42ba-ab8d-b0168a8eeb26] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:39:41.872828 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:39:41.878928 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-997ab67c-c049-4292-b217-2f2b7d7c5956 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:39:41.879383 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-997ab67c-c049-4292-b217-2f2b7d7c5956 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:39:41.880151 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-997ab67c-c049-4292-b217-2f2b7d7c5956 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:39:41.880593 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-997ab67c-c049-4292-b217-2f2b7d7c5956 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:39:41.884991 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=81 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:39:42.019281 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-997ab67c-c049-4292-b217-2f2b7d7c5956 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e53fdd4ca2b4fd8b64caea6924fa969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb62ca3babf9402996e0ef47fc0d8e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:39:42.027092 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-997ab67c-c049-4292-b217-2f2b7d7c5956 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "GET /compute/v2.1/servers/d137a37f-fa39-42ba-ab8d-b0168a8eeb26" status: 200 len: 1361 microversion: 2.1 time: 0.161810 Jun 16 12:39:42.028469 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 556/1103] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:39:41 2022] GET /compute/v2.1/servers/d137a37f-fa39-42ba-ab8d-b0168a8eeb26 => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:39:43.045393 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d3acb4d5-1c37-406d-904c-10b63c650422 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:39:43.046128 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d3acb4d5-1c37-406d-904c-10b63c650422 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: d137a37f-fa39-42ba-ab8d-b0168a8eeb26] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:39:43.052591 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d3acb4d5-1c37-406d-904c-10b63c650422 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:39:43.053046 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d3acb4d5-1c37-406d-904c-10b63c650422 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:39:43.053857 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d3acb4d5-1c37-406d-904c-10b63c650422 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:39:43.054312 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d3acb4d5-1c37-406d-904c-10b63c650422 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:39:43.187985 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d3acb4d5-1c37-406d-904c-10b63c650422 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e53fdd4ca2b4fd8b64caea6924fa969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb62ca3babf9402996e0ef47fc0d8e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:39:43.195402 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d3acb4d5-1c37-406d-904c-10b63c650422 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "GET /compute/v2.1/servers/d137a37f-fa39-42ba-ab8d-b0168a8eeb26" status: 200 len: 1361 microversion: 2.1 time: 0.154775 Jun 16 12:39:43.195975 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 548/1104] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:39:43 2022] GET /compute/v2.1/servers/d137a37f-fa39-42ba-ab8d-b0168a8eeb26 => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:39:44.212324 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1885bf22-22f9-4b39-a7d0-97cb31f156dd tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:39:44.212863 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1885bf22-22f9-4b39-a7d0-97cb31f156dd tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: d137a37f-fa39-42ba-ab8d-b0168a8eeb26] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:39:44.219367 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1885bf22-22f9-4b39-a7d0-97cb31f156dd tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:39:44.219813 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1885bf22-22f9-4b39-a7d0-97cb31f156dd tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:39:44.220569 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1885bf22-22f9-4b39-a7d0-97cb31f156dd tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:39:44.221006 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1885bf22-22f9-4b39-a7d0-97cb31f156dd tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:39:44.350459 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1885bf22-22f9-4b39-a7d0-97cb31f156dd tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e53fdd4ca2b4fd8b64caea6924fa969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb62ca3babf9402996e0ef47fc0d8e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:39:44.359042 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1885bf22-22f9-4b39-a7d0-97cb31f156dd tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "GET /compute/v2.1/servers/d137a37f-fa39-42ba-ab8d-b0168a8eeb26" status: 200 len: 1361 microversion: 2.1 time: 0.150600 Jun 16 12:39:44.359610 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 557/1105] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:39:44 2022] GET /compute/v2.1/servers/d137a37f-fa39-42ba-ab8d-b0168a8eeb26 => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:39:45.051290 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-e161bb5c-a3fe-42db-ad5d-51f09ddd5412 req-5dbb7c1e-04b0-45f3-9e72-6d44b19a42a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d137a37f-fa39-42ba-ab8d-b0168a8eeb26", "name": "network-vif-plugged", "status": "completed", "tag": "6b2a3cde-71be-4d17-b027-059d51f5cd96"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:39:45.066421 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-e161bb5c-a3fe-42db-ad5d-51f09ddd5412 req-5dbb7c1e-04b0-45f3-9e72-6d44b19a42a7 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:39:45.067128 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-e161bb5c-a3fe-42db-ad5d-51f09ddd5412 req-5dbb7c1e-04b0-45f3-9e72-6d44b19a42a7 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:39:45.085670 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-e161bb5c-a3fe-42db-ad5d-51f09ddd5412 req-5dbb7c1e-04b0-45f3-9e72-6d44b19a42a7 service nova] Creating event network-vif-plugged:6b2a3cde-71be-4d17-b027-059d51f5cd96 for instance d137a37f-fa39-42ba-ab8d-b0168a8eeb26 on hv-cinder-84614 Jun 16 12:39:45.095458 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-e161bb5c-a3fe-42db-ad5d-51f09ddd5412 req-5dbb7c1e-04b0-45f3-9e72-6d44b19a42a7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048194 Jun 16 12:39:45.096383 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 549/1106] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:39:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:39:45.376052 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-9c702d50-0daf-41e8-b3c2-342b25525fb4 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:39:45.376658 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-9c702d50-0daf-41e8-b3c2-342b25525fb4 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: d137a37f-fa39-42ba-ab8d-b0168a8eeb26] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:39:45.383823 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9c702d50-0daf-41e8-b3c2-342b25525fb4 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:39:45.384274 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9c702d50-0daf-41e8-b3c2-342b25525fb4 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:39:45.385044 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9c702d50-0daf-41e8-b3c2-342b25525fb4 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:39:45.385483 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9c702d50-0daf-41e8-b3c2-342b25525fb4 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:39:45.536240 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-9c702d50-0daf-41e8-b3c2-342b25525fb4 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e53fdd4ca2b4fd8b64caea6924fa969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb62ca3babf9402996e0ef47fc0d8e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:39:45.544957 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-9c702d50-0daf-41e8-b3c2-342b25525fb4 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "GET /compute/v2.1/servers/d137a37f-fa39-42ba-ab8d-b0168a8eeb26" status: 200 len: 1361 microversion: 2.1 time: 0.172767 Jun 16 12:39:45.545543 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 558/1107] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:39:45 2022] GET /compute/v2.1/servers/d137a37f-fa39-42ba-ab8d-b0168a8eeb26 => generated 1361 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:39:46.564373 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1ce7c34f-7551-4c88-80e4-9646bd80c434 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:39:46.565066 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1ce7c34f-7551-4c88-80e4-9646bd80c434 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: d137a37f-fa39-42ba-ab8d-b0168a8eeb26] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:39:46.571676 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1ce7c34f-7551-4c88-80e4-9646bd80c434 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:39:46.572117 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1ce7c34f-7551-4c88-80e4-9646bd80c434 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:39:46.572866 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1ce7c34f-7551-4c88-80e4-9646bd80c434 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:39:46.573295 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1ce7c34f-7551-4c88-80e4-9646bd80c434 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:39:46.700131 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1ce7c34f-7551-4c88-80e4-9646bd80c434 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e53fdd4ca2b4fd8b64caea6924fa969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb62ca3babf9402996e0ef47fc0d8e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:39:46.707718 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1ce7c34f-7551-4c88-80e4-9646bd80c434 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "GET /compute/v2.1/servers/d137a37f-fa39-42ba-ab8d-b0168a8eeb26" status: 200 len: 1361 microversion: 2.1 time: 0.147790 Jun 16 12:39:46.708281 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 550/1108] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:39:46 2022] GET /compute/v2.1/servers/d137a37f-fa39-42ba-ab8d-b0168a8eeb26 => generated 1361 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:39:47.724456 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8db2095d-826a-4441-873b-4a9d65dc4e43 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:39:47.725067 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8db2095d-826a-4441-873b-4a9d65dc4e43 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: d137a37f-fa39-42ba-ab8d-b0168a8eeb26] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:39:47.727364 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell0:SELECT=2 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:39:47.728029 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell0:SELECT=6 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:39:47.734469 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8db2095d-826a-4441-873b-4a9d65dc4e43 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:39:47.734923 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8db2095d-826a-4441-873b-4a9d65dc4e43 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:39:47.735683 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8db2095d-826a-4441-873b-4a9d65dc4e43 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:39:47.736120 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8db2095d-826a-4441-873b-4a9d65dc4e43 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:39:47.868373 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8db2095d-826a-4441-873b-4a9d65dc4e43 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e53fdd4ca2b4fd8b64caea6924fa969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb62ca3babf9402996e0ef47fc0d8e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:39:47.875890 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8db2095d-826a-4441-873b-4a9d65dc4e43 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "GET /compute/v2.1/servers/d137a37f-fa39-42ba-ab8d-b0168a8eeb26" status: 200 len: 1546 microversion: 2.1 time: 0.155256 Jun 16 12:39:47.876468 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 559/1109] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:39:47 2022] GET /compute/v2.1/servers/d137a37f-fa39-42ba-ab8d-b0168a8eeb26 => generated 1546 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:39:47.892453 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fdc247fe-68af-46cd-9061-3ae1e1f41152 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:39:47.892953 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-fdc247fe-68af-46cd-9061-3ae1e1f41152 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: d137a37f-fa39-42ba-ab8d-b0168a8eeb26] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:39:47.894940 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=6 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:39:47.901547 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fdc247fe-68af-46cd-9061-3ae1e1f41152 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:39:47.902024 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fdc247fe-68af-46cd-9061-3ae1e1f41152 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:39:47.903526 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fdc247fe-68af-46cd-9061-3ae1e1f41152 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:39:47.903974 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fdc247fe-68af-46cd-9061-3ae1e1f41152 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:39:47.983250 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-fdc247fe-68af-46cd-9061-3ae1e1f41152 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "GET /compute/v2.1/servers/d137a37f-fa39-42ba-ab8d-b0168a8eeb26/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094599 Jun 16 12:39:47.983845 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 551/1110] 10.222.0.45 () {58 vars in 1274 bytes} [Thu Jun 16 12:39:47 2022] GET /compute/v2.1/servers/d137a37f-fa39-42ba-ab8d-b0168a8eeb26/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:39:48.893174 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-ce999d92-5b85-4d7d-b6a4-98c54c1a19b9 req-0caaa40a-e814-42f5-862c-0b7d452f256c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d137a37f-fa39-42ba-ab8d-b0168a8eeb26", "tag": "6b2a3cde-71be-4d17-b027-059d51f5cd96"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:39:48.902055 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-ce999d92-5b85-4d7d-b6a4-98c54c1a19b9 req-0caaa40a-e814-42f5-862c-0b7d452f256c service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:39:48.903193 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-ce999d92-5b85-4d7d-b6a4-98c54c1a19b9 req-0caaa40a-e814-42f5-862c-0b7d452f256c service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:39:48.914112 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-ce999d92-5b85-4d7d-b6a4-98c54c1a19b9 req-0caaa40a-e814-42f5-862c-0b7d452f256c service nova] Creating event network-changed:6b2a3cde-71be-4d17-b027-059d51f5cd96 for instance d137a37f-fa39-42ba-ab8d-b0168a8eeb26 on hv-cinder-84614 Jun 16 12:39:48.919726 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-ce999d92-5b85-4d7d-b6a4-98c54c1a19b9 req-0caaa40a-e814-42f5-862c-0b7d452f256c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030241 Jun 16 12:39:48.920398 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 560/1111] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:39:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:41:03.971292 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=9 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:41:03.972088 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=23 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:41:03.976951 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8c7b3234-045b-4ab5-86c9-8d43be39b197 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:41:03.977501 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8c7b3234-045b-4ab5-86c9-8d43be39b197 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: d137a37f-fa39-42ba-ab8d-b0168a8eeb26] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:41:03.984252 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8c7b3234-045b-4ab5-86c9-8d43be39b197 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:03.984699 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8c7b3234-045b-4ab5-86c9-8d43be39b197 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:03.986097 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8c7b3234-045b-4ab5-86c9-8d43be39b197 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:03.986540 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8c7b3234-045b-4ab5-86c9-8d43be39b197 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:04.008985 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8c7b3234-045b-4ab5-86c9-8d43be39b197 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "GET /compute/v2.1/servers/d137a37f-fa39-42ba-ab8d-b0168a8eeb26/ips" status: 200 len: 145 microversion: 2.1 time: 0.040174 Jun 16 12:41:04.009549 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 552/1112] 10.222.0.45 () {58 vars in 1247 bytes} [Thu Jun 16 12:41:03 2022] GET /compute/v2.1/servers/d137a37f-fa39-42ba-ab8d-b0168a8eeb26/ips => generated 145 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:41:05.321463 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=9 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:41:05.322226 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=25 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:41:05.326733 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b5887e17-1725-4277-a03e-380f859d954c tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8f4f46e7-0265-4927-b311-5d341ce8875c"}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:41:05.327874 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b5887e17-1725-4277-a03e-380f859d954c tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: d137a37f-fa39-42ba-ab8d-b0168a8eeb26] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:41:05.335352 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b5887e17-1725-4277-a03e-380f859d954c tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:05.335801 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b5887e17-1725-4277-a03e-380f859d954c tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:05.336564 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b5887e17-1725-4277-a03e-380f859d954c tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:05.337002 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b5887e17-1725-4277-a03e-380f859d954c tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:05.581456 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b5887e17-1725-4277-a03e-380f859d954c tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "POST /compute/v2.1/servers/d137a37f-fa39-42ba-ab8d-b0168a8eeb26/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.261703 Jun 16 12:41:05.582120 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 561/1113] 10.222.0.45 () {60 vars in 1322 bytes} [Thu Jun 16 12:41:05 2022] POST /compute/v2.1/servers/d137a37f-fa39-42ba-ab8d-b0168a8eeb26/os-volume_attachments => generated 194 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:41:13.067165 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-71a83f9e-2286-4158-a1fe-85f46d3379fc tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:41:13.068096 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-71a83f9e-2286-4158-a1fe-85f46d3379fc tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: d137a37f-fa39-42ba-ab8d-b0168a8eeb26] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:41:13.074545 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-71a83f9e-2286-4158-a1fe-85f46d3379fc tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:13.075001 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-71a83f9e-2286-4158-a1fe-85f46d3379fc tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:13.075765 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-71a83f9e-2286-4158-a1fe-85f46d3379fc tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:13.076207 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-71a83f9e-2286-4158-a1fe-85f46d3379fc tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:13.105459 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-71a83f9e-2286-4158-a1fe-85f46d3379fc tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "GET /compute/v2.1/servers/d137a37f-fa39-42ba-ab8d-b0168a8eeb26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042757 Jun 16 12:41:13.106026 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 553/1114] 10.222.0.45 () {58 vars in 1301 bytes} [Thu Jun 16 12:41:13 2022] GET /compute/v2.1/servers/d137a37f-fa39-42ba-ab8d-b0168a8eeb26/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:41:13.117464 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e6a5a561-9961-439d-881b-e53f8200bfb3 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:41:13.118073 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e6a5a561-9961-439d-881b-e53f8200bfb3 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: d137a37f-fa39-42ba-ab8d-b0168a8eeb26] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:41:13.124202 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e6a5a561-9961-439d-881b-e53f8200bfb3 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:13.124650 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e6a5a561-9961-439d-881b-e53f8200bfb3 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:13.125408 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e6a5a561-9961-439d-881b-e53f8200bfb3 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:13.125845 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e6a5a561-9961-439d-881b-e53f8200bfb3 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:13.155793 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e6a5a561-9961-439d-881b-e53f8200bfb3 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "GET /compute/v2.1/servers/d137a37f-fa39-42ba-ab8d-b0168a8eeb26/os-volume_attachments/8f4f46e7-0265-4927-b311-5d341ce8875c" status: 200 len: 194 microversion: 2.1 time: 0.043064 Jun 16 12:41:13.156371 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 562/1115] 10.222.0.45 () {58 vars in 1412 bytes} [Thu Jun 16 12:41:13 2022] GET /compute/v2.1/servers/d137a37f-fa39-42ba-ab8d-b0168a8eeb26/os-volume_attachments/8f4f46e7-0265-4927-b311-5d341ce8875c => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:41:14.470295 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-cf73e03d-adee-44c0-bfcb-5c3298ae7723 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "07db5dc1-834b-4c45-ac2c-f60a62144b20"}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:41:14.471371 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-cf73e03d-adee-44c0-bfcb-5c3298ae7723 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: d137a37f-fa39-42ba-ab8d-b0168a8eeb26] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:41:14.477919 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cf73e03d-adee-44c0-bfcb-5c3298ae7723 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:14.478380 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cf73e03d-adee-44c0-bfcb-5c3298ae7723 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:14.479144 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cf73e03d-adee-44c0-bfcb-5c3298ae7723 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:14.479587 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cf73e03d-adee-44c0-bfcb-5c3298ae7723 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:14.723158 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-cf73e03d-adee-44c0-bfcb-5c3298ae7723 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "POST /compute/v2.1/servers/d137a37f-fa39-42ba-ab8d-b0168a8eeb26/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.256775 Jun 16 12:41:14.723757 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 554/1116] 10.222.0.45 () {60 vars in 1322 bytes} [Thu Jun 16 12:41:14 2022] POST /compute/v2.1/servers/d137a37f-fa39-42ba-ab8d-b0168a8eeb26/os-volume_attachments => generated 194 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:41:22.209758 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b7aa8f85-d05b-463f-833b-58ecee91eb67 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:41:22.210861 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b7aa8f85-d05b-463f-833b-58ecee91eb67 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: d137a37f-fa39-42ba-ab8d-b0168a8eeb26] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:41:22.217414 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b7aa8f85-d05b-463f-833b-58ecee91eb67 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:22.217911 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b7aa8f85-d05b-463f-833b-58ecee91eb67 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:22.218681 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b7aa8f85-d05b-463f-833b-58ecee91eb67 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:22.219118 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b7aa8f85-d05b-463f-833b-58ecee91eb67 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:22.248310 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b7aa8f85-d05b-463f-833b-58ecee91eb67 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "GET /compute/v2.1/servers/d137a37f-fa39-42ba-ab8d-b0168a8eeb26/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042470 Jun 16 12:41:22.248865 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 563/1117] 10.222.0.45 () {58 vars in 1301 bytes} [Thu Jun 16 12:41:22 2022] GET /compute/v2.1/servers/d137a37f-fa39-42ba-ab8d-b0168a8eeb26/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:41:22.390913 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3a928316-8eca-4d4f-b142-ba9fbfb18bfe tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:41:22.391508 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3a928316-8eca-4d4f-b142-ba9fbfb18bfe tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: d137a37f-fa39-42ba-ab8d-b0168a8eeb26] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:41:22.397749 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3a928316-8eca-4d4f-b142-ba9fbfb18bfe tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:22.398240 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3a928316-8eca-4d4f-b142-ba9fbfb18bfe tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:22.399010 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3a928316-8eca-4d4f-b142-ba9fbfb18bfe tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:22.399455 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3a928316-8eca-4d4f-b142-ba9fbfb18bfe tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:22.428152 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3a928316-8eca-4d4f-b142-ba9fbfb18bfe tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "GET /compute/v2.1/servers/d137a37f-fa39-42ba-ab8d-b0168a8eeb26/os-volume_attachments/8f4f46e7-0265-4927-b311-5d341ce8875c" status: 200 len: 194 microversion: 2.1 time: 0.042102 Jun 16 12:41:22.428736 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 555/1118] 10.222.0.45 () {58 vars in 1412 bytes} [Thu Jun 16 12:41:22 2022] GET /compute/v2.1/servers/d137a37f-fa39-42ba-ab8d-b0168a8eeb26/os-volume_attachments/8f4f46e7-0265-4927-b311-5d341ce8875c => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:41:22.438443 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0b3eb233-26c1-4538-8b94-9f6ec6e8364c tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:41:22.439982 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0b3eb233-26c1-4538-8b94-9f6ec6e8364c tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: d137a37f-fa39-42ba-ab8d-b0168a8eeb26] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:41:22.445511 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0b3eb233-26c1-4538-8b94-9f6ec6e8364c tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:22.445994 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0b3eb233-26c1-4538-8b94-9f6ec6e8364c tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:22.446752 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0b3eb233-26c1-4538-8b94-9f6ec6e8364c tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:22.447186 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0b3eb233-26c1-4538-8b94-9f6ec6e8364c tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:22.525069 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.objects.instance [None req-0b3eb233-26c1-4538-8b94-9f6ec6e8364c tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lazy-loading 'services' on Instance uuid d137a37f-fa39-42ba-ab8d-b0168a8eeb26 {{(pid=117607) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 12:41:22.600005 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0b3eb233-26c1-4538-8b94-9f6ec6e8364c tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "DELETE /compute/v2.1/servers/d137a37f-fa39-42ba-ab8d-b0168a8eeb26/os-volume_attachments/8f4f46e7-0265-4927-b311-5d341ce8875c" status: 202 len: 0 microversion: 2.1 time: 0.165250 Jun 16 12:41:22.600622 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 564/1119] 10.222.0.45 () {58 vars in 1415 bytes} [Thu Jun 16 12:41:22 2022] DELETE /compute/v2.1/servers/d137a37f-fa39-42ba-ab8d-b0168a8eeb26/os-volume_attachments/8f4f46e7-0265-4927-b311-5d341ce8875c => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 12:41:23.716071 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4edadeac-ee1c-45cd-a3f1-3392fa3d2ea4 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:41:23.716656 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4edadeac-ee1c-45cd-a3f1-3392fa3d2ea4 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: d137a37f-fa39-42ba-ab8d-b0168a8eeb26] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:41:23.723955 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4edadeac-ee1c-45cd-a3f1-3392fa3d2ea4 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:23.724527 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4edadeac-ee1c-45cd-a3f1-3392fa3d2ea4 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:23.725442 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4edadeac-ee1c-45cd-a3f1-3392fa3d2ea4 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:23.725936 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4edadeac-ee1c-45cd-a3f1-3392fa3d2ea4 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:23.755990 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4edadeac-ee1c-45cd-a3f1-3392fa3d2ea4 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "GET /compute/v2.1/servers/d137a37f-fa39-42ba-ab8d-b0168a8eeb26/os-volume_attachments/07db5dc1-834b-4c45-ac2c-f60a62144b20" status: 200 len: 194 microversion: 2.1 time: 0.043896 Jun 16 12:41:23.756585 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 556/1120] 10.222.0.45 () {58 vars in 1412 bytes} [Thu Jun 16 12:41:23 2022] GET /compute/v2.1/servers/d137a37f-fa39-42ba-ab8d-b0168a8eeb26/os-volume_attachments/07db5dc1-834b-4c45-ac2c-f60a62144b20 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:41:23.768479 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-920a73bf-7738-4c75-bc17-1b3ccc907474 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:41:23.769062 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-920a73bf-7738-4c75-bc17-1b3ccc907474 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: d137a37f-fa39-42ba-ab8d-b0168a8eeb26] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:41:23.775195 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-920a73bf-7738-4c75-bc17-1b3ccc907474 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:23.775635 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-920a73bf-7738-4c75-bc17-1b3ccc907474 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:23.776640 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-920a73bf-7738-4c75-bc17-1b3ccc907474 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:23.777070 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-920a73bf-7738-4c75-bc17-1b3ccc907474 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:23.859302 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.objects.instance [None req-920a73bf-7738-4c75-bc17-1b3ccc907474 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lazy-loading 'services' on Instance uuid d137a37f-fa39-42ba-ab8d-b0168a8eeb26 {{(pid=117607) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 12:41:23.929266 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-920a73bf-7738-4c75-bc17-1b3ccc907474 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "DELETE /compute/v2.1/servers/d137a37f-fa39-42ba-ab8d-b0168a8eeb26/os-volume_attachments/07db5dc1-834b-4c45-ac2c-f60a62144b20" status: 202 len: 0 microversion: 2.1 time: 0.166560 Jun 16 12:41:23.929854 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 565/1121] 10.222.0.45 () {58 vars in 1415 bytes} [Thu Jun 16 12:41:23 2022] DELETE /compute/v2.1/servers/d137a37f-fa39-42ba-ab8d-b0168a8eeb26/os-volume_attachments/07db5dc1-834b-4c45-ac2c-f60a62144b20 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 12:41:25.095893 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0eb2799d-8fcb-422d-a480-23ab06fffdef tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:41:25.096962 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0eb2799d-8fcb-422d-a480-23ab06fffdef tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: d137a37f-fa39-42ba-ab8d-b0168a8eeb26] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:41:25.103636 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0eb2799d-8fcb-422d-a480-23ab06fffdef tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:25.104090 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0eb2799d-8fcb-422d-a480-23ab06fffdef tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:25.104858 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0eb2799d-8fcb-422d-a480-23ab06fffdef tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:25.105297 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0eb2799d-8fcb-422d-a480-23ab06fffdef tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:25.133544 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0eb2799d-8fcb-422d-a480-23ab06fffdef tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "GET /compute/v2.1/servers/d137a37f-fa39-42ba-ab8d-b0168a8eeb26/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041659 Jun 16 12:41:25.134125 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 557/1122] 10.222.0.45 () {58 vars in 1301 bytes} [Thu Jun 16 12:41:25 2022] GET /compute/v2.1/servers/d137a37f-fa39-42ba-ab8d-b0168a8eeb26/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 12:41:25.236823 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-454b0965-0d7d-4421-a006-61327dc9e1f6 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:41:25.238364 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-454b0965-0d7d-4421-a006-61327dc9e1f6 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: d137a37f-fa39-42ba-ab8d-b0168a8eeb26] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:41:25.244647 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-454b0965-0d7d-4421-a006-61327dc9e1f6 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:25.245033 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-454b0965-0d7d-4421-a006-61327dc9e1f6 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:25.245821 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-454b0965-0d7d-4421-a006-61327dc9e1f6 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:25.246281 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-454b0965-0d7d-4421-a006-61327dc9e1f6 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:25.276213 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-454b0965-0d7d-4421-a006-61327dc9e1f6 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "GET /compute/v2.1/servers/d137a37f-fa39-42ba-ab8d-b0168a8eeb26/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043832 Jun 16 12:41:25.276774 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 566/1123] 10.222.0.45 () {58 vars in 1301 bytes} [Thu Jun 16 12:41:25 2022] GET /compute/v2.1/servers/d137a37f-fa39-42ba-ab8d-b0168a8eeb26/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 12:41:25.333394 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b1acea36-4159-4c8f-81b2-d95e03af5865 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:41:25.333913 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b1acea36-4159-4c8f-81b2-d95e03af5865 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: d137a37f-fa39-42ba-ab8d-b0168a8eeb26] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:41:25.339821 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b1acea36-4159-4c8f-81b2-d95e03af5865 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:25.340275 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b1acea36-4159-4c8f-81b2-d95e03af5865 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:25.341042 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b1acea36-4159-4c8f-81b2-d95e03af5865 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:25.341485 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b1acea36-4159-4c8f-81b2-d95e03af5865 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:25.368084 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b1acea36-4159-4c8f-81b2-d95e03af5865 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: d137a37f-fa39-42ba-ab8d-b0168a8eeb26] Going to try to terminate instance {{(pid=117606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 12:41:25.441730 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b1acea36-4159-4c8f-81b2-d95e03af5865 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "DELETE /compute/v2.1/servers/d137a37f-fa39-42ba-ab8d-b0168a8eeb26" status: 204 len: 0 microversion: 2.1 time: 0.111592 Jun 16 12:41:25.442462 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 558/1124] 10.222.0.45 () {58 vars in 1238 bytes} [Thu Jun 16 12:41:25 2022] DELETE /compute/v2.1/servers/d137a37f-fa39-42ba-ab8d-b0168a8eeb26 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 12:41:25.450691 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2d2913e0-9743-48f5-8a84-5936a2bc4aa8 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:41:25.451306 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2d2913e0-9743-48f5-8a84-5936a2bc4aa8 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: d137a37f-fa39-42ba-ab8d-b0168a8eeb26] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:41:25.457819 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2d2913e0-9743-48f5-8a84-5936a2bc4aa8 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:25.458300 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2d2913e0-9743-48f5-8a84-5936a2bc4aa8 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:25.459065 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2d2913e0-9743-48f5-8a84-5936a2bc4aa8 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:25.459500 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2d2913e0-9743-48f5-8a84-5936a2bc4aa8 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:25.592654 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2d2913e0-9743-48f5-8a84-5936a2bc4aa8 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e53fdd4ca2b4fd8b64caea6924fa969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb62ca3babf9402996e0ef47fc0d8e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:41:25.600188 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2d2913e0-9743-48f5-8a84-5936a2bc4aa8 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "GET /compute/v2.1/servers/d137a37f-fa39-42ba-ab8d-b0168a8eeb26" status: 200 len: 1671 microversion: 2.1 time: 0.153265 Jun 16 12:41:25.600754 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 567/1125] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:41:25 2022] GET /compute/v2.1/servers/d137a37f-fa39-42ba-ab8d-b0168a8eeb26 => generated 1671 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:41:26.618965 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7eabbd84-9ccd-4a47-b827-c0c736e55627 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:41:26.619589 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7eabbd84-9ccd-4a47-b827-c0c736e55627 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: d137a37f-fa39-42ba-ab8d-b0168a8eeb26] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:41:26.625979 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7eabbd84-9ccd-4a47-b827-c0c736e55627 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:26.626425 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7eabbd84-9ccd-4a47-b827-c0c736e55627 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:26.627178 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7eabbd84-9ccd-4a47-b827-c0c736e55627 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:26.627608 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7eabbd84-9ccd-4a47-b827-c0c736e55627 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:26.757753 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7eabbd84-9ccd-4a47-b827-c0c736e55627 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e53fdd4ca2b4fd8b64caea6924fa969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb62ca3babf9402996e0ef47fc0d8e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:41:26.765320 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7eabbd84-9ccd-4a47-b827-c0c736e55627 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "GET /compute/v2.1/servers/d137a37f-fa39-42ba-ab8d-b0168a8eeb26" status: 200 len: 1671 microversion: 2.1 time: 0.150673 Jun 16 12:41:26.765891 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 559/1126] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:41:26 2022] GET /compute/v2.1/servers/d137a37f-fa39-42ba-ab8d-b0168a8eeb26 => generated 1671 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:41:27.783981 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-cae98654-943b-46e9-ad76-a0903389670b tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:41:27.784598 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-cae98654-943b-46e9-ad76-a0903389670b tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: d137a37f-fa39-42ba-ab8d-b0168a8eeb26] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:41:27.791196 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cae98654-943b-46e9-ad76-a0903389670b tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:27.791655 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cae98654-943b-46e9-ad76-a0903389670b tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:27.792420 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cae98654-943b-46e9-ad76-a0903389670b tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:27.792864 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cae98654-943b-46e9-ad76-a0903389670b tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:27.999187 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-cae98654-943b-46e9-ad76-a0903389670b tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e53fdd4ca2b4fd8b64caea6924fa969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb62ca3babf9402996e0ef47fc0d8e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:41:28.007648 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-cae98654-943b-46e9-ad76-a0903389670b tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "GET /compute/v2.1/servers/d137a37f-fa39-42ba-ab8d-b0168a8eeb26" status: 200 len: 1671 microversion: 2.1 time: 0.227468 Jun 16 12:41:28.008239 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 568/1127] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:41:27 2022] GET /compute/v2.1/servers/d137a37f-fa39-42ba-ab8d-b0168a8eeb26 => generated 1671 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:41:28.330275 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-d097965b-b047-4842-ba9b-a1b43864e2f5 req-81380ae7-4d89-4359-b1f8-38d542dd09bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d137a37f-fa39-42ba-ab8d-b0168a8eeb26", "name": "network-vif-deleted", "tag": "6b2a3cde-71be-4d17-b027-059d51f5cd96"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:41:28.339741 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-d097965b-b047-4842-ba9b-a1b43864e2f5 req-81380ae7-4d89-4359-b1f8-38d542dd09bd service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:28.340208 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-d097965b-b047-4842-ba9b-a1b43864e2f5 req-81380ae7-4d89-4359-b1f8-38d542dd09bd service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:28.356605 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-d097965b-b047-4842-ba9b-a1b43864e2f5 req-81380ae7-4d89-4359-b1f8-38d542dd09bd service nova] Creating event network-vif-deleted:6b2a3cde-71be-4d17-b027-059d51f5cd96 for instance d137a37f-fa39-42ba-ab8d-b0168a8eeb26 on hv-cinder-84614 Jun 16 12:41:28.364385 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-d097965b-b047-4842-ba9b-a1b43864e2f5 req-81380ae7-4d89-4359-b1f8-38d542dd09bd service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038371 Jun 16 12:41:28.365051 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 560/1128] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:41:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:41:29.026540 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6e9a8549-8ea7-432a-b698-543a7be296d0 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:41:29.027092 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6e9a8549-8ea7-432a-b698-543a7be296d0 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: d137a37f-fa39-42ba-ab8d-b0168a8eeb26] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:41:29.033533 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6e9a8549-8ea7-432a-b698-543a7be296d0 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:29.034054 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6e9a8549-8ea7-432a-b698-543a7be296d0 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:29.034826 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6e9a8549-8ea7-432a-b698-543a7be296d0 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:29.035270 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6e9a8549-8ea7-432a-b698-543a7be296d0 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:29.049043 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-6e9a8549-8ea7-432a-b698-543a7be296d0 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] HTTP exception thrown: Instance d137a37f-fa39-42ba-ab8d-b0168a8eeb26 could not be found. Jun 16 12:41:29.050749 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6e9a8549-8ea7-432a-b698-543a7be296d0 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Request method failure captured: Jun 16 12:41:29.050749 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: request: GET /compute/v2.1/servers/d137a37f-fa39-42ba-ab8d-b0168a8eeb26 HTTP/1.1 Jun 16 12:41:29.050749 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Accept: application/json Jun 16 12:41:29.050749 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jun 16 12:41:29.050749 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Connection: close Jun 16 12:41:29.050749 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jun 16 12:41:29.050749 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jun 16 12:41:29.050749 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Host: 10.222.0.45 Jun 16 12:41:29.050749 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jun 16 12:41:29.050749 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jun 16 12:41:29.050749 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABiqyNXlybMpWRuddoduOrNogIVdUlE_kj6OPm37PeG33-vpWOxd1JWof2ZCUk8ebzvPHBQ02Y2oDvYk1GCsU-8iPo_IE7Le4k3HG-hymCiPmjgBkvr0TbsO4Tj01mZyVYRgDplCaD-jIgvgAjSJEajM_Q5CtIxDtk5cxQvKbuJZ8Nb_tM Jun 16 12:41:29.050749 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jun 16 12:41:29.050749 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jun 16 12:41:29.050749 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jun 16 12:41:29.050749 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jun 16 12:41:29.050749 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jun 16 12:41:29.050749 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jun 16 12:41:29.050749 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Id: eb62ca3babf9402996e0ef47fc0d8e81 Jun 16 12:41:29.050749 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-AttachVolumeTestJSON-501064817 Jun 16 12:41:29.050749 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Role: member,reader Jun 16 12:41:29.050749 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Roles: member,reader Jun 16 12:41:29.052954 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/eb62ca3babf9402996e0ef47fc0d8e81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/eb62ca3babf9402996e0ef47fc0d8e81"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_eb62ca3babf9402996e0ef47fc0d8e81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/eb62ca3babf9402996e0ef47fc0d8e81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Jun 16 12:41:29.052954 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-AttachVolumeTestJSON-501064817 Jun 16 12:41:29.052954 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant-Id: eb62ca3babf9402996e0ef47fc0d8e81 Jun 16 12:41:29.052954 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-AttachVolumeTestJSON-501064817 Jun 16 12:41:29.052954 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User: tempest-AttachVolumeTestJSON-501064817-project Jun 16 12:41:29.052954 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jun 16 12:41:29.052954 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jun 16 12:41:29.052954 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Id: 1e53fdd4ca2b4fd8b64caea6924fa969 Jun 16 12:41:29.052954 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-AttachVolumeTestJSON-501064817-project Jun 16 12:41:29.052954 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: method: > Jun 16 12:41:29.052954 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: exception: Instance d137a37f-fa39-42ba-ab8d-b0168a8eeb26 could not be found. Jun 16 12:41:29.052954 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: action_args: {'id': 'd137a37f-fa39-42ba-ab8d-b0168a8eeb26'} Jun 16 12:41:29.053768 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:41:29.053768 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:41:29.053768 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:41:29.053768 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:41:29.053768 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:41:29.053768 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:41:29.053768 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:41:29.053768 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:41:29.053768 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:41:29.053768 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:41:29.053768 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d137a37f-fa39-42ba-ab8d-b0168a8eeb26 could not be found. Jun 16 12:41:29.053768 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:41:29.053768 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:41:29.053768 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:41:29.053768 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:41:29.053768 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:41:29.053768 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:41:29.053768 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:41:29.053768 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:41:29.053768 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:41:29.055888 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:41:29.055888 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 12:41:29.055888 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 12:41:29.055888 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:41:29.055888 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:41:29.055888 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:41:29.055888 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:41:29.055888 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d137a37f-fa39-42ba-ab8d-b0168a8eeb26 could not be found. Jun 16 12:41:29.055888 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:41:29.055888 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:41:29.055888 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:41:29.055888 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:41:29.055888 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:41:29.055888 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:41:29.055888 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:41:29.055888 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:41:29.055888 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d137a37f-fa39-42ba-ab8d-b0168a8eeb26 could not be found. Jun 16 12:41:29.055888 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:41:29.057550 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6e9a8549-8ea7-432a-b698-543a7be296d0 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Returning 404 to user: Instance d137a37f-fa39-42ba-ab8d-b0168a8eeb26 could not be found. {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:41:29.057550 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6e9a8549-8ea7-432a-b698-543a7be296d0 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "GET /compute/v2.1/servers/d137a37f-fa39-42ba-ab8d-b0168a8eeb26" status: 404 len: 111 microversion: 2.1 time: 0.030673 Jun 16 12:41:29.057550 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 569/1129] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:41:29 2022] GET /compute/v2.1/servers/d137a37f-fa39-42ba-ab8d-b0168a8eeb26 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 12:41:29.064219 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-de3d24d6-7e29-4321-925b-1a39ba180f75 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '.version_select at 0x7f7c722348b0>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:41:29.081520 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-de3d24d6-7e29-4321-925b-1a39ba180f75 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-382349755" status: 202 len: 0 microversion: 2.1 time: 0.021436 Jun 16 12:41:29.082131 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 561/1130] 10.222.0.45 () {58 vars in 1217 bytes} [Thu Jun 16 12:41:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-382349755 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 12:41:31.964666 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e5ec97dc-7380-438c-bef4-3593ac8a027c tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:41:31.965196 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e5ec97dc-7380-438c-bef4-3593ac8a027c tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: d137a37f-fa39-42ba-ab8d-b0168a8eeb26] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:41:31.971790 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e5ec97dc-7380-438c-bef4-3593ac8a027c tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:31.972224 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e5ec97dc-7380-438c-bef4-3593ac8a027c tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:31.973492 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e5ec97dc-7380-438c-bef4-3593ac8a027c tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:31.974019 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e5ec97dc-7380-438c-bef4-3593ac8a027c tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:31.989295 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-e5ec97dc-7380-438c-bef4-3593ac8a027c tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] HTTP exception thrown: Instance d137a37f-fa39-42ba-ab8d-b0168a8eeb26 could not be found. Jun 16 12:41:31.990845 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e5ec97dc-7380-438c-bef4-3593ac8a027c tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Request method failure captured: Jun 16 12:41:31.990845 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: request: DELETE /compute/v2.1/servers/d137a37f-fa39-42ba-ab8d-b0168a8eeb26 HTTP/1.1 Jun 16 12:41:31.990845 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Accept: application/json Jun 16 12:41:31.990845 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jun 16 12:41:31.990845 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Connection: close Jun 16 12:41:31.990845 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jun 16 12:41:31.990845 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jun 16 12:41:31.990845 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Host: 10.222.0.45 Jun 16 12:41:31.990845 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jun 16 12:41:31.990845 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jun 16 12:41:31.990845 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABiqyNXlybMpWRuddoduOrNogIVdUlE_kj6OPm37PeG33-vpWOxd1JWof2ZCUk8ebzvPHBQ02Y2oDvYk1GCsU-8iPo_IE7Le4k3HG-hymCiPmjgBkvr0TbsO4Tj01mZyVYRgDplCaD-jIgvgAjSJEajM_Q5CtIxDtk5cxQvKbuJZ8Nb_tM Jun 16 12:41:31.990845 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jun 16 12:41:31.990845 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jun 16 12:41:31.990845 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jun 16 12:41:31.990845 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jun 16 12:41:31.990845 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jun 16 12:41:31.990845 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jun 16 12:41:31.990845 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Id: eb62ca3babf9402996e0ef47fc0d8e81 Jun 16 12:41:31.990845 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-AttachVolumeTestJSON-501064817 Jun 16 12:41:31.990845 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Role: member,reader Jun 16 12:41:31.990845 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Roles: member,reader Jun 16 12:41:31.992390 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/eb62ca3babf9402996e0ef47fc0d8e81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/eb62ca3babf9402996e0ef47fc0d8e81"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_eb62ca3babf9402996e0ef47fc0d8e81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/eb62ca3babf9402996e0ef47fc0d8e81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Jun 16 12:41:31.992390 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-AttachVolumeTestJSON-501064817 Jun 16 12:41:31.992390 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant-Id: eb62ca3babf9402996e0ef47fc0d8e81 Jun 16 12:41:31.992390 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-AttachVolumeTestJSON-501064817 Jun 16 12:41:31.992390 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User: tempest-AttachVolumeTestJSON-501064817-project Jun 16 12:41:31.992390 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jun 16 12:41:31.992390 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jun 16 12:41:31.992390 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Id: 1e53fdd4ca2b4fd8b64caea6924fa969 Jun 16 12:41:31.992390 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-AttachVolumeTestJSON-501064817-project Jun 16 12:41:31.992390 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: method: > Jun 16 12:41:31.992390 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: exception: Instance d137a37f-fa39-42ba-ab8d-b0168a8eeb26 could not be found. Jun 16 12:41:31.992390 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: action_args: {'id': 'd137a37f-fa39-42ba-ab8d-b0168a8eeb26'} Jun 16 12:41:31.993164 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:41:31.993164 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:41:31.993164 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:41:31.993164 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:41:31.993164 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:41:31.993164 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:41:31.993164 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:41:31.993164 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:41:31.993164 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:41:31.993164 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:41:31.993164 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d137a37f-fa39-42ba-ab8d-b0168a8eeb26 could not be found. Jun 16 12:41:31.993164 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:41:31.993164 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:41:31.993164 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:41:31.993164 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:41:31.993164 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:41:31.993164 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:41:31.993164 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:41:31.993164 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:41:31.993164 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:41:31.994477 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:41:31.994477 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 12:41:31.994477 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 12:41:31.994477 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 12:41:31.994477 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 12:41:31.994477 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:41:31.994477 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:41:31.994477 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:41:31.994477 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:41:31.994477 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d137a37f-fa39-42ba-ab8d-b0168a8eeb26 could not be found. Jun 16 12:41:31.994477 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:41:31.994477 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:41:31.994477 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:41:31.994477 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:41:31.994477 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:41:31.994477 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:41:31.994477 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:41:31.994477 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:41:31.994477 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d137a37f-fa39-42ba-ab8d-b0168a8eeb26 could not be found. Jun 16 12:41:31.994477 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:41:31.995756 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e5ec97dc-7380-438c-bef4-3593ac8a027c tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Returning 404 to user: Instance d137a37f-fa39-42ba-ab8d-b0168a8eeb26 could not be found. {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:41:31.995756 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e5ec97dc-7380-438c-bef4-3593ac8a027c tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "DELETE /compute/v2.1/servers/d137a37f-fa39-42ba-ab8d-b0168a8eeb26" status: 404 len: 111 microversion: 2.1 time: 0.031429 Jun 16 12:41:31.995756 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 570/1131] 10.222.0.45 () {58 vars in 1238 bytes} [Thu Jun 16 12:41:31 2022] DELETE /compute/v2.1/servers/d137a37f-fa39-42ba-ab8d-b0168a8eeb26 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 12:41:32.001575 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a7eee3fc-a351-4a08-a748-e5ed1261a593 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:41:32.002334 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a7eee3fc-a351-4a08-a748-e5ed1261a593 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: d137a37f-fa39-42ba-ab8d-b0168a8eeb26] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:41:32.008549 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a7eee3fc-a351-4a08-a748-e5ed1261a593 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:32.008999 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a7eee3fc-a351-4a08-a748-e5ed1261a593 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:32.009760 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a7eee3fc-a351-4a08-a748-e5ed1261a593 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:32.010229 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a7eee3fc-a351-4a08-a748-e5ed1261a593 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:32.023346 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-a7eee3fc-a351-4a08-a748-e5ed1261a593 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] HTTP exception thrown: Instance d137a37f-fa39-42ba-ab8d-b0168a8eeb26 could not be found. Jun 16 12:41:32.024964 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a7eee3fc-a351-4a08-a748-e5ed1261a593 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Request method failure captured: Jun 16 12:41:32.024964 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: request: GET /compute/v2.1/servers/d137a37f-fa39-42ba-ab8d-b0168a8eeb26 HTTP/1.1 Jun 16 12:41:32.024964 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 16 12:41:32.024964 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 16 12:41:32.024964 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Connection: close Jun 16 12:41:32.024964 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 16 12:41:32.024964 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 16 12:41:32.024964 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Host: 10.222.0.45 Jun 16 12:41:32.024964 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 16 12:41:32.024964 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 16 12:41:32.024964 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABiqyNXlybMpWRuddoduOrNogIVdUlE_kj6OPm37PeG33-vpWOxd1JWof2ZCUk8ebzvPHBQ02Y2oDvYk1GCsU-8iPo_IE7Le4k3HG-hymCiPmjgBkvr0TbsO4Tj01mZyVYRgDplCaD-jIgvgAjSJEajM_Q5CtIxDtk5cxQvKbuJZ8Nb_tM Jun 16 12:41:32.024964 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 16 12:41:32.024964 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 16 12:41:32.024964 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 16 12:41:32.024964 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 16 12:41:32.024964 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 16 12:41:32.024964 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 16 12:41:32.024964 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Id: eb62ca3babf9402996e0ef47fc0d8e81 Jun 16 12:41:32.024964 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-AttachVolumeTestJSON-501064817 Jun 16 12:41:32.024964 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 16 12:41:32.024964 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 16 12:41:32.026804 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/eb62ca3babf9402996e0ef47fc0d8e81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/eb62ca3babf9402996e0ef47fc0d8e81"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_eb62ca3babf9402996e0ef47fc0d8e81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/eb62ca3babf9402996e0ef47fc0d8e81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Jun 16 12:41:32.026804 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-AttachVolumeTestJSON-501064817 Jun 16 12:41:32.026804 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant-Id: eb62ca3babf9402996e0ef47fc0d8e81 Jun 16 12:41:32.026804 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-AttachVolumeTestJSON-501064817 Jun 16 12:41:32.026804 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User: tempest-AttachVolumeTestJSON-501064817-project Jun 16 12:41:32.026804 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 16 12:41:32.026804 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 16 12:41:32.026804 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Id: 1e53fdd4ca2b4fd8b64caea6924fa969 Jun 16 12:41:32.026804 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-AttachVolumeTestJSON-501064817-project Jun 16 12:41:32.026804 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: method: > Jun 16 12:41:32.026804 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: exception: Instance d137a37f-fa39-42ba-ab8d-b0168a8eeb26 could not be found. Jun 16 12:41:32.026804 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: action_args: {'id': 'd137a37f-fa39-42ba-ab8d-b0168a8eeb26'} Jun 16 12:41:32.027709 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:41:32.027709 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:41:32.027709 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:41:32.027709 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:41:32.027709 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:41:32.027709 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:41:32.027709 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:41:32.027709 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:41:32.027709 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:41:32.027709 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:41:32.027709 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d137a37f-fa39-42ba-ab8d-b0168a8eeb26 could not be found. Jun 16 12:41:32.027709 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:41:32.027709 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:41:32.027709 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:41:32.027709 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:41:32.027709 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:41:32.027709 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:41:32.027709 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:41:32.027709 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:41:32.027709 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:41:32.029307 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:41:32.029307 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 12:41:32.029307 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 12:41:32.029307 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:41:32.029307 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:41:32.029307 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:41:32.029307 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:41:32.029307 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d137a37f-fa39-42ba-ab8d-b0168a8eeb26 could not be found. Jun 16 12:41:32.029307 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:41:32.029307 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:41:32.029307 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:41:32.029307 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:41:32.029307 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:41:32.029307 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:41:32.029307 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:41:32.029307 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:41:32.029307 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d137a37f-fa39-42ba-ab8d-b0168a8eeb26 could not be found. Jun 16 12:41:32.029307 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:41:32.033351 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a7eee3fc-a351-4a08-a748-e5ed1261a593 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Returning 404 to user: Instance d137a37f-fa39-42ba-ab8d-b0168a8eeb26 could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:41:32.033351 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a7eee3fc-a351-4a08-a748-e5ed1261a593 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "GET /compute/v2.1/servers/d137a37f-fa39-42ba-ab8d-b0168a8eeb26" status: 404 len: 111 microversion: 2.1 time: 0.029191 Jun 16 12:41:32.033351 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 562/1132] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:41:31 2022] GET /compute/v2.1/servers/d137a37f-fa39-42ba-ab8d-b0168a8eeb26 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 12:41:33.160531 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e629f3c0-40ed-4709-9d69-811a7730fa5d tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:41:33.161022 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e629f3c0-40ed-4709-9d69-811a7730fa5d tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: 8e91b2d7-1250-4cca-965d-c18107d8c3a1] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:41:33.168003 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e629f3c0-40ed-4709-9d69-811a7730fa5d tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:33.168450 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e629f3c0-40ed-4709-9d69-811a7730fa5d tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:33.169366 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e629f3c0-40ed-4709-9d69-811a7730fa5d tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:33.169811 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e629f3c0-40ed-4709-9d69-811a7730fa5d tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:33.183794 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-e629f3c0-40ed-4709-9d69-811a7730fa5d tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] HTTP exception thrown: Instance 8e91b2d7-1250-4cca-965d-c18107d8c3a1 could not be found. Jun 16 12:41:33.185299 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e629f3c0-40ed-4709-9d69-811a7730fa5d tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Request method failure captured: Jun 16 12:41:33.185299 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: request: DELETE /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1 HTTP/1.1 Jun 16 12:41:33.185299 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Accept: application/json Jun 16 12:41:33.185299 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jun 16 12:41:33.185299 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Connection: close Jun 16 12:41:33.185299 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jun 16 12:41:33.185299 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jun 16 12:41:33.185299 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Host: 10.222.0.45 Jun 16 12:41:33.185299 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jun 16 12:41:33.185299 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jun 16 12:41:33.185299 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABiqyNXlybMpWRuddoduOrNogIVdUlE_kj6OPm37PeG33-vpWOxd1JWof2ZCUk8ebzvPHBQ02Y2oDvYk1GCsU-8iPo_IE7Le4k3HG-hymCiPmjgBkvr0TbsO4Tj01mZyVYRgDplCaD-jIgvgAjSJEajM_Q5CtIxDtk5cxQvKbuJZ8Nb_tM Jun 16 12:41:33.185299 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jun 16 12:41:33.185299 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jun 16 12:41:33.185299 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jun 16 12:41:33.185299 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jun 16 12:41:33.185299 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jun 16 12:41:33.185299 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jun 16 12:41:33.185299 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Id: eb62ca3babf9402996e0ef47fc0d8e81 Jun 16 12:41:33.185299 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-AttachVolumeTestJSON-501064817 Jun 16 12:41:33.185299 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Role: member,reader Jun 16 12:41:33.185299 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Roles: member,reader Jun 16 12:41:33.186956 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/eb62ca3babf9402996e0ef47fc0d8e81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/eb62ca3babf9402996e0ef47fc0d8e81"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_eb62ca3babf9402996e0ef47fc0d8e81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/eb62ca3babf9402996e0ef47fc0d8e81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Jun 16 12:41:33.186956 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-AttachVolumeTestJSON-501064817 Jun 16 12:41:33.186956 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant-Id: eb62ca3babf9402996e0ef47fc0d8e81 Jun 16 12:41:33.186956 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-AttachVolumeTestJSON-501064817 Jun 16 12:41:33.186956 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User: tempest-AttachVolumeTestJSON-501064817-project Jun 16 12:41:33.186956 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jun 16 12:41:33.186956 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jun 16 12:41:33.186956 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Id: 1e53fdd4ca2b4fd8b64caea6924fa969 Jun 16 12:41:33.186956 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-AttachVolumeTestJSON-501064817-project Jun 16 12:41:33.186956 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: method: > Jun 16 12:41:33.186956 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: exception: Instance 8e91b2d7-1250-4cca-965d-c18107d8c3a1 could not be found. Jun 16 12:41:33.186956 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: action_args: {'id': '8e91b2d7-1250-4cca-965d-c18107d8c3a1'} Jun 16 12:41:33.187928 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:41:33.187928 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:41:33.187928 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:41:33.187928 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:41:33.187928 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:41:33.187928 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:41:33.187928 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:41:33.187928 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:41:33.187928 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:41:33.187928 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:41:33.187928 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e91b2d7-1250-4cca-965d-c18107d8c3a1 could not be found. Jun 16 12:41:33.187928 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:41:33.187928 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:41:33.187928 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:41:33.187928 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:41:33.187928 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:41:33.187928 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:41:33.187928 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:41:33.187928 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:41:33.187928 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:41:33.189431 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:41:33.189431 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 12:41:33.189431 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 12:41:33.189431 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 12:41:33.189431 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 12:41:33.189431 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:41:33.189431 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:41:33.189431 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:41:33.189431 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:41:33.189431 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e91b2d7-1250-4cca-965d-c18107d8c3a1 could not be found. Jun 16 12:41:33.189431 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:41:33.189431 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:41:33.189431 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:41:33.189431 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:41:33.189431 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:41:33.189431 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:41:33.189431 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:41:33.189431 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:41:33.189431 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e91b2d7-1250-4cca-965d-c18107d8c3a1 could not be found. Jun 16 12:41:33.189431 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:41:33.191044 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e629f3c0-40ed-4709-9d69-811a7730fa5d tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Returning 404 to user: Instance 8e91b2d7-1250-4cca-965d-c18107d8c3a1 could not be found. {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:41:33.191044 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e629f3c0-40ed-4709-9d69-811a7730fa5d tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "DELETE /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1" status: 404 len: 111 microversion: 2.1 time: 0.030039 Jun 16 12:41:33.191044 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 571/1133] 10.222.0.45 () {58 vars in 1238 bytes} [Thu Jun 16 12:41:33 2022] DELETE /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 12:41:33.197041 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-eba6564d-f1cf-4de6-bda4-c3b055281316 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:41:33.197656 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-eba6564d-f1cf-4de6-bda4-c3b055281316 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] [instance: 8e91b2d7-1250-4cca-965d-c18107d8c3a1] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:41:33.204054 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eba6564d-f1cf-4de6-bda4-c3b055281316 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:33.204505 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eba6564d-f1cf-4de6-bda4-c3b055281316 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:33.205267 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eba6564d-f1cf-4de6-bda4-c3b055281316 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:33.205740 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eba6564d-f1cf-4de6-bda4-c3b055281316 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:33.219042 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-eba6564d-f1cf-4de6-bda4-c3b055281316 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] HTTP exception thrown: Instance 8e91b2d7-1250-4cca-965d-c18107d8c3a1 could not be found. Jun 16 12:41:33.220535 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-eba6564d-f1cf-4de6-bda4-c3b055281316 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Request method failure captured: Jun 16 12:41:33.220535 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: request: GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1 HTTP/1.1 Jun 16 12:41:33.220535 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 16 12:41:33.220535 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 16 12:41:33.220535 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Connection: close Jun 16 12:41:33.220535 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 16 12:41:33.220535 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 16 12:41:33.220535 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Host: 10.222.0.45 Jun 16 12:41:33.220535 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 16 12:41:33.220535 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 16 12:41:33.220535 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABiqyNXlybMpWRuddoduOrNogIVdUlE_kj6OPm37PeG33-vpWOxd1JWof2ZCUk8ebzvPHBQ02Y2oDvYk1GCsU-8iPo_IE7Le4k3HG-hymCiPmjgBkvr0TbsO4Tj01mZyVYRgDplCaD-jIgvgAjSJEajM_Q5CtIxDtk5cxQvKbuJZ8Nb_tM Jun 16 12:41:33.220535 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 16 12:41:33.220535 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 16 12:41:33.220535 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 16 12:41:33.220535 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 16 12:41:33.220535 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 16 12:41:33.220535 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 16 12:41:33.220535 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Id: eb62ca3babf9402996e0ef47fc0d8e81 Jun 16 12:41:33.220535 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-AttachVolumeTestJSON-501064817 Jun 16 12:41:33.220535 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 16 12:41:33.220535 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 16 12:41:33.222152 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/eb62ca3babf9402996e0ef47fc0d8e81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/eb62ca3babf9402996e0ef47fc0d8e81"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_eb62ca3babf9402996e0ef47fc0d8e81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/eb62ca3babf9402996e0ef47fc0d8e81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Jun 16 12:41:33.222152 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-AttachVolumeTestJSON-501064817 Jun 16 12:41:33.222152 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant-Id: eb62ca3babf9402996e0ef47fc0d8e81 Jun 16 12:41:33.222152 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-AttachVolumeTestJSON-501064817 Jun 16 12:41:33.222152 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User: tempest-AttachVolumeTestJSON-501064817-project Jun 16 12:41:33.222152 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 16 12:41:33.222152 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 16 12:41:33.222152 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Id: 1e53fdd4ca2b4fd8b64caea6924fa969 Jun 16 12:41:33.222152 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-AttachVolumeTestJSON-501064817-project Jun 16 12:41:33.222152 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: method: > Jun 16 12:41:33.222152 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: exception: Instance 8e91b2d7-1250-4cca-965d-c18107d8c3a1 could not be found. Jun 16 12:41:33.222152 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: action_args: {'id': '8e91b2d7-1250-4cca-965d-c18107d8c3a1'} Jun 16 12:41:33.223238 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:41:33.223238 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:41:33.223238 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:41:33.223238 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:41:33.223238 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:41:33.223238 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:41:33.223238 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:41:33.223238 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:41:33.223238 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:41:33.223238 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:41:33.223238 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e91b2d7-1250-4cca-965d-c18107d8c3a1 could not be found. Jun 16 12:41:33.223238 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:41:33.223238 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:41:33.223238 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:41:33.223238 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:41:33.223238 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:41:33.223238 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:41:33.223238 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:41:33.223238 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:41:33.223238 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:41:33.225258 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:41:33.225258 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 12:41:33.225258 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 12:41:33.225258 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:41:33.225258 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:41:33.225258 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:41:33.225258 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:41:33.225258 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e91b2d7-1250-4cca-965d-c18107d8c3a1 could not be found. Jun 16 12:41:33.225258 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:41:33.225258 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:41:33.225258 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:41:33.225258 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:41:33.225258 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:41:33.225258 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:41:33.225258 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:41:33.225258 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:41:33.225258 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e91b2d7-1250-4cca-965d-c18107d8c3a1 could not be found. Jun 16 12:41:33.225258 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:41:33.226886 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-eba6564d-f1cf-4de6-bda4-c3b055281316 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] Returning 404 to user: Instance 8e91b2d7-1250-4cca-965d-c18107d8c3a1 could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:41:33.226886 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-eba6564d-f1cf-4de6-bda4-c3b055281316 tempest-AttachVolumeTestJSON-501064817 tempest-AttachVolumeTestJSON-501064817-project] 10.222.0.45 "GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1" status: 404 len: 111 microversion: 2.1 time: 0.029487 Jun 16 12:41:33.226886 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 563/1134] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:41:33 2022] GET /compute/v2.1/servers/8e91b2d7-1250-4cca-965d-c18107d8c3a1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 12:41:37.580994 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6b0eaf10-4e9b-40ba-bcd8-c25ec6af0676 tempest-VolumesNegativeTest-1265236012 tempest-VolumesNegativeTest-1265236012-project] Action: 'create', calling method: .version_select at 0x7f7c72af54c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1201681791", "metadata": {"Type": "work"}}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:41:37.603004 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6b0eaf10-4e9b-40ba-bcd8-c25ec6af0676 tempest-VolumesNegativeTest-1265236012 tempest-VolumesNegativeTest-1265236012-project] Request method failure captured: Jun 16 12:41:37.603004 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 16 12:41:37.603004 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Accept: application/json Jun 16 12:41:37.603004 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jun 16 12:41:37.603004 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Connection: close Jun 16 12:41:37.603004 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Content-Length: 122 Jun 16 12:41:37.603004 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jun 16 12:41:37.603004 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Host: 10.222.0.45 Jun 16 12:41:37.603004 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jun 16 12:41:37.603004 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jun 16 12:41:37.603004 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABiqyUBUeDNj9Bzg7iGPBYg2_Lu2an4dQpTx2uHCGn6RDoZFBDerBdkWnFTNls9FrEsrqa_qGpuLCDfcHKujSkYzQascFi5BYgp_oGQAS81OUAhIHtlWCDDVfwxBEc9dpi6j2x2kCByZObD2FKN1e1Itp2ZrcyIawMFMFV_c3DdiJ3ACPM Jun 16 12:41:37.603004 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jun 16 12:41:37.603004 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jun 16 12:41:37.603004 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jun 16 12:41:37.603004 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jun 16 12:41:37.603004 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jun 16 12:41:37.603004 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jun 16 12:41:37.603004 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Id: ea7c9c869df2457baf609ef8aed59921 Jun 16 12:41:37.603004 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-VolumesNegativeTest-1265236012 Jun 16 12:41:37.603004 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Role: member,reader Jun 16 12:41:37.603004 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Roles: member,reader Jun 16 12:41:37.604656 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/ea7c9c869df2457baf609ef8aed59921"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ea7c9c869df2457baf609ef8aed59921"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_ea7c9c869df2457baf609ef8aed59921"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ea7c9c869df2457baf609ef8aed59921"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Jun 16 12:41:37.604656 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-VolumesNegativeTest-1265236012 Jun 16 12:41:37.604656 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant-Id: ea7c9c869df2457baf609ef8aed59921 Jun 16 12:41:37.604656 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-VolumesNegativeTest-1265236012 Jun 16 12:41:37.604656 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User: tempest-VolumesNegativeTest-1265236012-project Jun 16 12:41:37.604656 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jun 16 12:41:37.604656 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jun 16 12:41:37.604656 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Id: 014148a5e9b946fcbb5be089fb8889e2 Jun 16 12:41:37.604656 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-VolumesNegativeTest-1265236012-project Jun 16 12:41:37.604656 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Jun 16 12:41:37.604656 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1201681791", "metadata": {"Type": "work"}}} Jun 16 12:41:37.604656 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: method: Jun 16 12:41:37.604656 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 16 12:41:37.605856 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1201681791', 'metadata': {'Type': 'work'}}}} Jun 16 12:41:37.605856 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:41:37.605856 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:41:37.605856 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 12:41:37.605856 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 12:41:37.605856 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 12:41:37.605856 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise error Jun 16 12:41:37.605856 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 16 12:41:37.605856 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:41:37.605856 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 16 12:41:37.605856 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 16 12:41:37.605856 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:41:37.605856 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 16 12:41:37.605856 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi '#$%' Jun 16 12:41:37.605856 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:41:37.605856 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:41:37.605856 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:41:37.605856 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:41:37.605856 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:41:37.605856 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:41:37.605856 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:41:37.605856 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:41:37.607585 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 12:41:37.607585 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 12:41:37.607585 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:41:37.607585 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:41:37.607585 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 12:41:37.607585 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 12:41:37.607585 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 12:41:37.607585 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 12:41:37.607585 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 12:41:37.607585 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 12:41:37.607585 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 16 12:41:37.607585 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:41:37.607585 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:41:37.607585 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:41:37.607585 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:41:37.607585 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:41:37.607585 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:41:37.607585 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 12:41:37.607585 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 12:41:37.609135 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 16 12:41:37.609135 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:41:37.609135 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6b0eaf10-4e9b-40ba-bcd8-c25ec6af0676 tempest-VolumesNegativeTest-1265236012 tempest-VolumesNegativeTest-1265236012-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:41:37.609135 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6b0eaf10-4e9b-40ba-bcd8-c25ec6af0676 tempest-VolumesNegativeTest-1265236012 tempest-VolumesNegativeTest-1265236012-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.165346 Jun 16 12:41:37.609135 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 572/1135] 10.222.0.45 () {60 vars in 1155 bytes} [Thu Jun 16 12:41:37 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 166 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 16 12:41:37.614000 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4b1fb01a-6d18-4ff4-b223-e66c6e0e8ba2 tempest-VolumesNegativeTest-1265236012 tempest-VolumesNegativeTest-1265236012-project] Action: 'create', calling method: .version_select at 0x7f7c721ea1f0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-134494599", "metadata": {"Type": "work"}}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:41:37.617354 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4b1fb01a-6d18-4ff4-b223-e66c6e0e8ba2 tempest-VolumesNegativeTest-1265236012 tempest-VolumesNegativeTest-1265236012-project] Request method failure captured: Jun 16 12:41:37.617354 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 16 12:41:37.617354 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 16 12:41:37.617354 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 16 12:41:37.617354 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Connection: close Jun 16 12:41:37.617354 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Content-Length: 119 Jun 16 12:41:37.617354 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 16 12:41:37.617354 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Host: 10.222.0.45 Jun 16 12:41:37.617354 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 16 12:41:37.617354 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 16 12:41:37.617354 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABiqyUBUeDNj9Bzg7iGPBYg2_Lu2an4dQpTx2uHCGn6RDoZFBDerBdkWnFTNls9FrEsrqa_qGpuLCDfcHKujSkYzQascFi5BYgp_oGQAS81OUAhIHtlWCDDVfwxBEc9dpi6j2x2kCByZObD2FKN1e1Itp2ZrcyIawMFMFV_c3DdiJ3ACPM Jun 16 12:41:37.617354 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 16 12:41:37.617354 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 16 12:41:37.617354 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 16 12:41:37.617354 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 16 12:41:37.617354 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 16 12:41:37.617354 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 16 12:41:37.617354 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Id: ea7c9c869df2457baf609ef8aed59921 Jun 16 12:41:37.617354 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-VolumesNegativeTest-1265236012 Jun 16 12:41:37.617354 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 16 12:41:37.617354 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 16 12:41:37.618962 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/ea7c9c869df2457baf609ef8aed59921"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ea7c9c869df2457baf609ef8aed59921"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_ea7c9c869df2457baf609ef8aed59921"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ea7c9c869df2457baf609ef8aed59921"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Jun 16 12:41:37.618962 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-VolumesNegativeTest-1265236012 Jun 16 12:41:37.618962 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant-Id: ea7c9c869df2457baf609ef8aed59921 Jun 16 12:41:37.618962 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-VolumesNegativeTest-1265236012 Jun 16 12:41:37.618962 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User: tempest-VolumesNegativeTest-1265236012-project Jun 16 12:41:37.618962 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 16 12:41:37.618962 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 16 12:41:37.618962 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Id: 014148a5e9b946fcbb5be089fb8889e2 Jun 16 12:41:37.618962 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-VolumesNegativeTest-1265236012-project Jun 16 12:41:37.618962 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Jun 16 12:41:37.618962 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-134494599", "metadata": {"Type": "work"}}} Jun 16 12:41:37.618962 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: method: Jun 16 12:41:37.618962 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 16 12:41:37.620091 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-134494599', 'metadata': {'Type': 'work'}}}} Jun 16 12:41:37.620091 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:41:37.620091 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:41:37.620091 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 12:41:37.620091 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 12:41:37.620091 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 12:41:37.620091 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise error Jun 16 12:41:37.620091 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 16 12:41:37.620091 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:41:37.620091 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 16 12:41:37.620091 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 16 12:41:37.620091 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:41:37.620091 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 16 12:41:37.620091 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi '0' Jun 16 12:41:37.620091 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:41:37.620091 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:41:37.620091 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:41:37.620091 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:41:37.620091 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:41:37.620091 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:41:37.620091 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:41:37.620091 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:41:37.621699 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 12:41:37.621699 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 12:41:37.621699 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:41:37.621699 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:41:37.621699 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 12:41:37.621699 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 12:41:37.621699 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 12:41:37.621699 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 12:41:37.621699 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 12:41:37.621699 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 12:41:37.621699 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 16 12:41:37.621699 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:41:37.621699 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:41:37.621699 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:41:37.621699 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:41:37.621699 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:41:37.621699 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:41:37.621699 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 12:41:37.621699 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 12:41:37.623249 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 16 12:41:37.623249 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:41:37.623249 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4b1fb01a-6d18-4ff4-b223-e66c6e0e8ba2 tempest-VolumesNegativeTest-1265236012 tempest-VolumesNegativeTest-1265236012-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:41:37.623249 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4b1fb01a-6d18-4ff4-b223-e66c6e0e8ba2 tempest-VolumesNegativeTest-1265236012 tempest-VolumesNegativeTest-1265236012-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008694 Jun 16 12:41:37.623249 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 564/1136] 10.222.0.45 () {60 vars in 1155 bytes} [Thu Jun 16 12:41:37 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 12:41:37.627623 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-50d5a9d9-a44b-4227-ad5d-b94f0a87831a tempest-VolumesNegativeTest-1265236012 tempest-VolumesNegativeTest-1265236012-project] Action: 'create', calling method: .version_select at 0x7f7c72ce3dc0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-320043147", "metadata": {"Type": "work"}}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:41:37.629954 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-50d5a9d9-a44b-4227-ad5d-b94f0a87831a tempest-VolumesNegativeTest-1265236012 tempest-VolumesNegativeTest-1265236012-project] Request method failure captured: Jun 16 12:41:37.629954 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 16 12:41:37.629954 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Accept: application/json Jun 16 12:41:37.629954 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jun 16 12:41:37.629954 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Connection: close Jun 16 12:41:37.629954 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Content-Length: 118 Jun 16 12:41:37.629954 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jun 16 12:41:37.629954 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Host: 10.222.0.45 Jun 16 12:41:37.629954 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jun 16 12:41:37.629954 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jun 16 12:41:37.629954 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABiqyUBUeDNj9Bzg7iGPBYg2_Lu2an4dQpTx2uHCGn6RDoZFBDerBdkWnFTNls9FrEsrqa_qGpuLCDfcHKujSkYzQascFi5BYgp_oGQAS81OUAhIHtlWCDDVfwxBEc9dpi6j2x2kCByZObD2FKN1e1Itp2ZrcyIawMFMFV_c3DdiJ3ACPM Jun 16 12:41:37.629954 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jun 16 12:41:37.629954 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jun 16 12:41:37.629954 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jun 16 12:41:37.629954 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jun 16 12:41:37.629954 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jun 16 12:41:37.629954 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jun 16 12:41:37.629954 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Id: ea7c9c869df2457baf609ef8aed59921 Jun 16 12:41:37.629954 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-VolumesNegativeTest-1265236012 Jun 16 12:41:37.629954 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Role: member,reader Jun 16 12:41:37.629954 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Roles: member,reader Jun 16 12:41:37.631538 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/ea7c9c869df2457baf609ef8aed59921"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ea7c9c869df2457baf609ef8aed59921"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_ea7c9c869df2457baf609ef8aed59921"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ea7c9c869df2457baf609ef8aed59921"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Jun 16 12:41:37.631538 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-VolumesNegativeTest-1265236012 Jun 16 12:41:37.631538 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant-Id: ea7c9c869df2457baf609ef8aed59921 Jun 16 12:41:37.631538 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-VolumesNegativeTest-1265236012 Jun 16 12:41:37.631538 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User: tempest-VolumesNegativeTest-1265236012-project Jun 16 12:41:37.631538 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jun 16 12:41:37.631538 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jun 16 12:41:37.631538 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Id: 014148a5e9b946fcbb5be089fb8889e2 Jun 16 12:41:37.631538 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-VolumesNegativeTest-1265236012-project Jun 16 12:41:37.631538 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Jun 16 12:41:37.631538 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-320043147", "metadata": {"Type": "work"}}} Jun 16 12:41:37.631538 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: method: Jun 16 12:41:37.631538 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 16 12:41:37.632675 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-320043147', 'metadata': {'Type': 'work'}}}} Jun 16 12:41:37.632675 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:41:37.632675 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:41:37.632675 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 12:41:37.632675 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 12:41:37.632675 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 12:41:37.632675 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise error Jun 16 12:41:37.632675 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 16 12:41:37.632675 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:41:37.632675 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 16 12:41:37.632675 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 16 12:41:37.632675 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:41:37.632675 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 16 12:41:37.632675 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi '' Jun 16 12:41:37.632675 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:41:37.632675 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:41:37.632675 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:41:37.632675 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:41:37.632675 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:41:37.632675 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:41:37.632675 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:41:37.632675 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:41:37.634334 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 12:41:37.634334 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 12:41:37.634334 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:41:37.634334 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:41:37.634334 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 12:41:37.634334 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 12:41:37.634334 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 12:41:37.634334 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 12:41:37.634334 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 12:41:37.634334 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 12:41:37.634334 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 16 12:41:37.634334 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:41:37.634334 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:41:37.634334 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:41:37.634334 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:41:37.634334 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:41:37.634334 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:41:37.634334 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 12:41:37.634334 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 12:41:37.635795 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 16 12:41:37.635795 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:41:37.635795 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-50d5a9d9-a44b-4227-ad5d-b94f0a87831a tempest-VolumesNegativeTest-1265236012 tempest-VolumesNegativeTest-1265236012-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:41:37.635795 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-50d5a9d9-a44b-4227-ad5d-b94f0a87831a tempest-VolumesNegativeTest-1265236012 tempest-VolumesNegativeTest-1265236012-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007257 Jun 16 12:41:37.635795 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 573/1137] 10.222.0.45 () {60 vars in 1155 bytes} [Thu Jun 16 12:41:37 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 12:41:37.640915 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a1df1958-476b-43c9-a582-18985f621ba2 tempest-VolumesNegativeTest-1265236012 tempest-VolumesNegativeTest-1265236012-project] Calling method '.version_select at 0x7f7c736aa790>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:41:37.671165 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-a1df1958-476b-43c9-a582-18985f621ba2 tempest-VolumesNegativeTest-1265236012 tempest-VolumesNegativeTest-1265236012-project] HTTP exception thrown: Volume tempest-invalid-807229732 could not be found. Jun 16 12:41:37.673093 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a1df1958-476b-43c9-a582-18985f621ba2 tempest-VolumesNegativeTest-1265236012 tempest-VolumesNegativeTest-1265236012-project] Request method failure captured: Jun 16 12:41:37.673093 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-807229732 HTTP/1.1 Jun 16 12:41:37.673093 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 16 12:41:37.673093 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 16 12:41:37.673093 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Connection: close Jun 16 12:41:37.673093 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 16 12:41:37.673093 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 16 12:41:37.673093 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Host: 10.222.0.45 Jun 16 12:41:37.673093 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 16 12:41:37.673093 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 16 12:41:37.673093 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABiqyUBUeDNj9Bzg7iGPBYg2_Lu2an4dQpTx2uHCGn6RDoZFBDerBdkWnFTNls9FrEsrqa_qGpuLCDfcHKujSkYzQascFi5BYgp_oGQAS81OUAhIHtlWCDDVfwxBEc9dpi6j2x2kCByZObD2FKN1e1Itp2ZrcyIawMFMFV_c3DdiJ3ACPM Jun 16 12:41:37.673093 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 16 12:41:37.673093 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 16 12:41:37.673093 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 16 12:41:37.673093 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 16 12:41:37.673093 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 16 12:41:37.673093 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 16 12:41:37.673093 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Id: ea7c9c869df2457baf609ef8aed59921 Jun 16 12:41:37.673093 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-VolumesNegativeTest-1265236012 Jun 16 12:41:37.673093 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 16 12:41:37.673093 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 16 12:41:37.674967 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/ea7c9c869df2457baf609ef8aed59921"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ea7c9c869df2457baf609ef8aed59921"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_ea7c9c869df2457baf609ef8aed59921"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ea7c9c869df2457baf609ef8aed59921"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Jun 16 12:41:37.674967 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-VolumesNegativeTest-1265236012 Jun 16 12:41:37.674967 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant-Id: ea7c9c869df2457baf609ef8aed59921 Jun 16 12:41:37.674967 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-VolumesNegativeTest-1265236012 Jun 16 12:41:37.674967 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User: tempest-VolumesNegativeTest-1265236012-project Jun 16 12:41:37.674967 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 16 12:41:37.674967 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 16 12:41:37.674967 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Id: 014148a5e9b946fcbb5be089fb8889e2 Jun 16 12:41:37.674967 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-VolumesNegativeTest-1265236012-project Jun 16 12:41:37.674967 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: method: Jun 16 12:41:37.674967 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: exception: Volume tempest-invalid-807229732 could not be found. Jun 16 12:41:37.674967 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: action_args: {'id': 'tempest-invalid-807229732'} Jun 16 12:41:37.674967 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:41:37.676118 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:41:37.676118 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 12:41:37.676118 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 12:41:37.676118 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 12:41:37.676118 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 12:41:37.676118 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 12:41:37.676118 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 12:41:37.676118 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 12:41:37.676118 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 12:41:37.676118 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 12:41:37.676118 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 12:41:37.676118 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 12:41:37.676118 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 12:41:37.676118 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 12:41:37.676118 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 12:41:37.676118 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-807229732 could not be found. (HTTP 404) (Request-ID: req-314a3a62-8c2f-499f-b4e0-5ad8805953b8) Jun 16 12:41:37.676118 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:41:37.676118 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:41:37.676118 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:41:37.677572 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:41:37.677572 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 16 12:41:37.677572 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 16 12:41:37.677572 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 12:41:37.677572 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 12:41:37.677572 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 12:41:37.677572 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 12:41:37.677572 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 12:41:37.677572 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 12:41:37.677572 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 12:41:37.677572 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 12:41:37.677572 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 12:41:37.677572 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 12:41:37.677572 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 12:41:37.677572 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 12:41:37.677572 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 12:41:37.677572 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 12:41:37.677572 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 12:41:37.677572 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 12:41:37.679168 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 12:41:37.679168 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 12:41:37.679168 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 12:41:37.679168 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 12:41:37.679168 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-807229732 could not be found. Jun 16 12:41:37.679168 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:41:37.679168 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:41:37.679168 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:41:37.679168 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:41:37.679168 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:41:37.679168 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:41:37.679168 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:41:37.679168 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:41:37.679168 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 12:41:37.679168 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 12:41:37.679168 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:41:37.679168 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:41:37.679168 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 16 12:41:37.679168 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:41:37.679168 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-807229732 could not be found. Jun 16 12:41:37.680685 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:41:37.680685 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:41:37.680685 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:41:37.680685 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:41:37.680685 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:41:37.680685 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:41:37.680685 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:41:37.680685 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:41:37.680685 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-807229732 could not be found. Jun 16 12:41:37.680685 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:41:37.680685 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a1df1958-476b-43c9-a582-18985f621ba2 tempest-VolumesNegativeTest-1265236012 tempest-VolumesNegativeTest-1265236012-project] Returning 404 to user: Volume tempest-invalid-807229732 could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:41:37.680685 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a1df1958-476b-43c9-a582-18985f621ba2 tempest-VolumesNegativeTest-1265236012 tempest-VolumesNegativeTest-1265236012-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/tempest-invalid-807229732" status: 404 len: 98 microversion: 2.1 time: 0.037887 Jun 16 12:41:37.680685 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 565/1138] 10.222.0.45 () {58 vars in 1214 bytes} [Thu Jun 16 12:41:37 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-807229732 => generated 98 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 12:41:37.685293 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1f336f6c-aaff-4359-b39d-e7590a3e8243 tempest-VolumesNegativeTest-1265236012 tempest-VolumesNegativeTest-1265236012-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003736 Jun 16 12:41:37.685787 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 574/1139] 10.222.0.45 () {58 vars in 1139 bytes} [Thu Jun 16 12:41:37 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 16 12:41:37.694115 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b14c2d31-cef6-4ecf-bacf-fb991f93c6de tempest-VolumesNegativeTest-1265236012 tempest-VolumesNegativeTest-1265236012-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003905 Jun 16 12:41:37.694650 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 566/1140] 10.222.0.45 () {58 vars in 1136 bytes} [Thu Jun 16 12:41:37 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 16 12:41:37.702890 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e77fb8be-0084-4a13-9cd2-784a0b3fc648 tempest-VolumesNegativeTest-1265236012 tempest-VolumesNegativeTest-1265236012-project] Calling method '.version_select at 0x7f7c73f32c10>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:41:37.731897 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-e77fb8be-0084-4a13-9cd2-784a0b3fc648 tempest-VolumesNegativeTest-1265236012 tempest-VolumesNegativeTest-1265236012-project] HTTP exception thrown: Volume e39d6f99-d6ec-470f-9d76-46200ac25560 could not be found. Jun 16 12:41:37.733968 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e77fb8be-0084-4a13-9cd2-784a0b3fc648 tempest-VolumesNegativeTest-1265236012 tempest-VolumesNegativeTest-1265236012-project] Request method failure captured: Jun 16 12:41:37.733968 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: request: DELETE /compute/v2.1/os-volumes/e39d6f99-d6ec-470f-9d76-46200ac25560 HTTP/1.1 Jun 16 12:41:37.733968 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Accept: application/json Jun 16 12:41:37.733968 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jun 16 12:41:37.733968 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Connection: close Jun 16 12:41:37.733968 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jun 16 12:41:37.733968 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jun 16 12:41:37.733968 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Host: 10.222.0.45 Jun 16 12:41:37.733968 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jun 16 12:41:37.733968 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jun 16 12:41:37.733968 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABiqyUBUeDNj9Bzg7iGPBYg2_Lu2an4dQpTx2uHCGn6RDoZFBDerBdkWnFTNls9FrEsrqa_qGpuLCDfcHKujSkYzQascFi5BYgp_oGQAS81OUAhIHtlWCDDVfwxBEc9dpi6j2x2kCByZObD2FKN1e1Itp2ZrcyIawMFMFV_c3DdiJ3ACPM Jun 16 12:41:37.733968 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jun 16 12:41:37.733968 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jun 16 12:41:37.733968 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jun 16 12:41:37.733968 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jun 16 12:41:37.733968 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jun 16 12:41:37.733968 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jun 16 12:41:37.733968 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Id: ea7c9c869df2457baf609ef8aed59921 Jun 16 12:41:37.733968 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-VolumesNegativeTest-1265236012 Jun 16 12:41:37.733968 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Role: member,reader Jun 16 12:41:37.733968 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Roles: member,reader Jun 16 12:41:37.735399 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/ea7c9c869df2457baf609ef8aed59921"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ea7c9c869df2457baf609ef8aed59921"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_ea7c9c869df2457baf609ef8aed59921"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ea7c9c869df2457baf609ef8aed59921"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Jun 16 12:41:37.735399 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-VolumesNegativeTest-1265236012 Jun 16 12:41:37.735399 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant-Id: ea7c9c869df2457baf609ef8aed59921 Jun 16 12:41:37.735399 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-VolumesNegativeTest-1265236012 Jun 16 12:41:37.735399 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User: tempest-VolumesNegativeTest-1265236012-project Jun 16 12:41:37.735399 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jun 16 12:41:37.735399 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jun 16 12:41:37.735399 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Id: 014148a5e9b946fcbb5be089fb8889e2 Jun 16 12:41:37.735399 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-VolumesNegativeTest-1265236012-project Jun 16 12:41:37.735399 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: method: Jun 16 12:41:37.735399 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: exception: Volume e39d6f99-d6ec-470f-9d76-46200ac25560 could not be found. Jun 16 12:41:37.735399 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: action_args: {'id': 'e39d6f99-d6ec-470f-9d76-46200ac25560'} Jun 16 12:41:37.735399 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:41:37.736250 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:41:37.736250 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 12:41:37.736250 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 12:41:37.736250 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 12:41:37.736250 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 12:41:37.736250 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 12:41:37.736250 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 12:41:37.736250 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 12:41:37.736250 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 12:41:37.736250 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 12:41:37.736250 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 12:41:37.736250 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 12:41:37.736250 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 12:41:37.736250 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 12:41:37.736250 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 12:41:37.736250 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e39d6f99-d6ec-470f-9d76-46200ac25560 could not be found. (HTTP 404) (Request-ID: req-c02a711f-6967-4a57-b1a9-5a867f6635b3) Jun 16 12:41:37.736250 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:41:37.736250 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:41:37.736250 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:41:37.737529 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:41:37.737529 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 16 12:41:37.737529 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 16 12:41:37.737529 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 12:41:37.737529 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 12:41:37.737529 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 12:41:37.737529 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 12:41:37.737529 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 12:41:37.737529 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 12:41:37.737529 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 12:41:37.737529 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 12:41:37.737529 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 12:41:37.737529 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 12:41:37.737529 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 12:41:37.737529 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 12:41:37.737529 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 12:41:37.737529 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 12:41:37.737529 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 12:41:37.737529 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 12:41:37.738782 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 12:41:37.738782 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 12:41:37.738782 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 12:41:37.738782 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 12:41:37.738782 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e39d6f99-d6ec-470f-9d76-46200ac25560 could not be found. Jun 16 12:41:37.738782 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:41:37.738782 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:41:37.738782 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:41:37.738782 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:41:37.738782 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:41:37.738782 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:41:37.738782 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:41:37.738782 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:41:37.738782 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 12:41:37.738782 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 12:41:37.738782 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:41:37.738782 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:41:37.738782 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 16 12:41:37.738782 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:41:37.740586 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e39d6f99-d6ec-470f-9d76-46200ac25560 could not be found. Jun 16 12:41:37.740586 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:41:37.740586 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:41:37.740586 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:41:37.740586 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:41:37.740586 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:41:37.740586 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:41:37.740586 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:41:37.740586 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:41:37.740586 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e39d6f99-d6ec-470f-9d76-46200ac25560 could not be found. Jun 16 12:41:37.740586 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:41:37.740586 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e77fb8be-0084-4a13-9cd2-784a0b3fc648 tempest-VolumesNegativeTest-1265236012 tempest-VolumesNegativeTest-1265236012-project] Returning 404 to user: Volume e39d6f99-d6ec-470f-9d76-46200ac25560 could not be found. {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:41:37.740586 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e77fb8be-0084-4a13-9cd2-784a0b3fc648 tempest-VolumesNegativeTest-1265236012 tempest-VolumesNegativeTest-1265236012-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/e39d6f99-d6ec-470f-9d76-46200ac25560" status: 404 len: 109 microversion: 2.1 time: 0.036250 Jun 16 12:41:37.740586 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 575/1141] 10.222.0.45 () {58 vars in 1247 bytes} [Thu Jun 16 12:41:37 2022] DELETE /compute/v2.1/os-volumes/e39d6f99-d6ec-470f-9d76-46200ac25560 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 12:41:37.745239 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1958a356-aaa6-405b-9116-6c3d8fee2696 tempest-VolumesNegativeTest-1265236012 tempest-VolumesNegativeTest-1265236012-project] Calling method '.version_select at 0x7f7c7228a040>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:41:37.772344 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-1958a356-aaa6-405b-9116-6c3d8fee2696 tempest-VolumesNegativeTest-1265236012 tempest-VolumesNegativeTest-1265236012-project] HTTP exception thrown: Volume 17042738-a839-4179-8dd3-e69f72215bf5 could not be found. Jun 16 12:41:37.774293 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1958a356-aaa6-405b-9116-6c3d8fee2696 tempest-VolumesNegativeTest-1265236012 tempest-VolumesNegativeTest-1265236012-project] Request method failure captured: Jun 16 12:41:37.774293 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: request: GET /compute/v2.1/os-volumes/17042738-a839-4179-8dd3-e69f72215bf5 HTTP/1.1 Jun 16 12:41:37.774293 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 16 12:41:37.774293 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 16 12:41:37.774293 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Connection: close Jun 16 12:41:37.774293 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 16 12:41:37.774293 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 16 12:41:37.774293 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Host: 10.222.0.45 Jun 16 12:41:37.774293 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 16 12:41:37.774293 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 16 12:41:37.774293 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABiqyUBUeDNj9Bzg7iGPBYg2_Lu2an4dQpTx2uHCGn6RDoZFBDerBdkWnFTNls9FrEsrqa_qGpuLCDfcHKujSkYzQascFi5BYgp_oGQAS81OUAhIHtlWCDDVfwxBEc9dpi6j2x2kCByZObD2FKN1e1Itp2ZrcyIawMFMFV_c3DdiJ3ACPM Jun 16 12:41:37.774293 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 16 12:41:37.774293 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 16 12:41:37.774293 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 16 12:41:37.774293 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 16 12:41:37.774293 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 16 12:41:37.774293 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 16 12:41:37.774293 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Id: ea7c9c869df2457baf609ef8aed59921 Jun 16 12:41:37.774293 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-VolumesNegativeTest-1265236012 Jun 16 12:41:37.774293 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 16 12:41:37.774293 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 16 12:41:37.775933 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/ea7c9c869df2457baf609ef8aed59921"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ea7c9c869df2457baf609ef8aed59921"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_ea7c9c869df2457baf609ef8aed59921"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ea7c9c869df2457baf609ef8aed59921"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Jun 16 12:41:37.775933 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-VolumesNegativeTest-1265236012 Jun 16 12:41:37.775933 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant-Id: ea7c9c869df2457baf609ef8aed59921 Jun 16 12:41:37.775933 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-VolumesNegativeTest-1265236012 Jun 16 12:41:37.775933 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User: tempest-VolumesNegativeTest-1265236012-project Jun 16 12:41:37.775933 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 16 12:41:37.775933 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 16 12:41:37.775933 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Id: 014148a5e9b946fcbb5be089fb8889e2 Jun 16 12:41:37.775933 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-VolumesNegativeTest-1265236012-project Jun 16 12:41:37.775933 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: method: Jun 16 12:41:37.775933 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: exception: Volume 17042738-a839-4179-8dd3-e69f72215bf5 could not be found. Jun 16 12:41:37.775933 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: action_args: {'id': '17042738-a839-4179-8dd3-e69f72215bf5'} Jun 16 12:41:37.775933 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:41:37.777088 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:41:37.777088 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 12:41:37.777088 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 12:41:37.777088 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 12:41:37.777088 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 12:41:37.777088 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 12:41:37.777088 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 12:41:37.777088 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 12:41:37.777088 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 12:41:37.777088 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 12:41:37.777088 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 12:41:37.777088 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 12:41:37.777088 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 12:41:37.777088 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 12:41:37.777088 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 12:41:37.777088 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 17042738-a839-4179-8dd3-e69f72215bf5 could not be found. (HTTP 404) (Request-ID: req-baa4f9c8-a62a-4884-a511-43fe915e0a6b) Jun 16 12:41:37.777088 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:41:37.777088 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:41:37.777088 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:41:37.778441 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:41:37.778441 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 12:41:37.778441 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 12:41:37.778441 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 12:41:37.778441 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 12:41:37.778441 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 12:41:37.778441 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 12:41:37.778441 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 12:41:37.778441 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 12:41:37.778441 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 12:41:37.778441 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 12:41:37.778441 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 12:41:37.778441 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 12:41:37.778441 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 12:41:37.778441 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 12:41:37.778441 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 12:41:37.778441 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 12:41:37.778441 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 12:41:37.778441 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 12:41:37.779858 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 12:41:37.779858 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 12:41:37.779858 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 12:41:37.779858 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 12:41:37.779858 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 17042738-a839-4179-8dd3-e69f72215bf5 could not be found. Jun 16 12:41:37.779858 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:41:37.779858 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:41:37.779858 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:41:37.779858 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:41:37.779858 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:41:37.779858 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:41:37.779858 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:41:37.779858 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:41:37.779858 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 12:41:37.779858 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 12:41:37.779858 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:41:37.779858 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:41:37.779858 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 12:41:37.779858 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:41:37.781268 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 17042738-a839-4179-8dd3-e69f72215bf5 could not be found. Jun 16 12:41:37.781268 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:41:37.781268 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:41:37.781268 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:41:37.781268 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:41:37.781268 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:41:37.781268 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:41:37.781268 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:41:37.781268 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:41:37.781268 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 17042738-a839-4179-8dd3-e69f72215bf5 could not be found. Jun 16 12:41:37.781268 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:41:37.781268 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1958a356-aaa6-405b-9116-6c3d8fee2696 tempest-VolumesNegativeTest-1265236012 tempest-VolumesNegativeTest-1265236012-project] Returning 404 to user: Volume 17042738-a839-4179-8dd3-e69f72215bf5 could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:41:37.781268 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1958a356-aaa6-405b-9116-6c3d8fee2696 tempest-VolumesNegativeTest-1265236012 tempest-VolumesNegativeTest-1265236012-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/17042738-a839-4179-8dd3-e69f72215bf5" status: 404 len: 109 microversion: 2.1 time: 0.034440 Jun 16 12:41:37.781268 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 567/1142] 10.222.0.45 () {58 vars in 1244 bytes} [Thu Jun 16 12:41:37 2022] GET /compute/v2.1/os-volumes/17042738-a839-4179-8dd3-e69f72215bf5 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 12:41:42.630635 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5b9e143a-7310-4c55-ac1f-2808d03b1103 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:41:42.631167 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5b9e143a-7310-4c55-ac1f-2808d03b1103 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: 59e0a2bf-716d-4e85-8332-f5ca8ffac988] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:41:42.633125 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=23 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:41:42.639601 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5b9e143a-7310-4c55-ac1f-2808d03b1103 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:42.640058 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5b9e143a-7310-4c55-ac1f-2808d03b1103 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:42.640830 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5b9e143a-7310-4c55-ac1f-2808d03b1103 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:42.641270 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5b9e143a-7310-4c55-ac1f-2808d03b1103 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:42.643888 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:41:42.667062 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5b9e143a-7310-4c55-ac1f-2808d03b1103 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: 59e0a2bf-716d-4e85-8332-f5ca8ffac988] Going to try to terminate instance {{(pid=117607) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 12:41:42.740537 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5b9e143a-7310-4c55-ac1f-2808d03b1103 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "DELETE /compute/v2.1/servers/59e0a2bf-716d-4e85-8332-f5ca8ffac988" status: 204 len: 0 microversion: 2.1 time: 0.113416 Jun 16 12:41:42.741215 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 576/1143] 10.222.0.45 () {58 vars in 1238 bytes} [Thu Jun 16 12:41:42 2022] DELETE /compute/v2.1/servers/59e0a2bf-716d-4e85-8332-f5ca8ffac988 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 12:41:42.750215 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0953ce81-6cf4-4500-bb00-b3041fc2e5c5 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:41:42.750825 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0953ce81-6cf4-4500-bb00-b3041fc2e5c5 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: 59e0a2bf-716d-4e85-8332-f5ca8ffac988] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:41:42.752772 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:41:42.759649 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0953ce81-6cf4-4500-bb00-b3041fc2e5c5 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:42.760433 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0953ce81-6cf4-4500-bb00-b3041fc2e5c5 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:42.761756 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0953ce81-6cf4-4500-bb00-b3041fc2e5c5 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:42.762549 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0953ce81-6cf4-4500-bb00-b3041fc2e5c5 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:42.767921 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:41:42.898418 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0953ce81-6cf4-4500-bb00-b3041fc2e5c5 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab259dbcb84995aadd366f599afa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150f43b9e49a48ee9b72066f07fe95c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:41:42.906123 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0953ce81-6cf4-4500-bb00-b3041fc2e5c5 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "GET /compute/v2.1/servers/59e0a2bf-716d-4e85-8332-f5ca8ffac988" status: 200 len: 1576 microversion: 2.1 time: 0.160894 Jun 16 12:41:42.906684 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 568/1144] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:41:42 2022] GET /compute/v2.1/servers/59e0a2bf-716d-4e85-8332-f5ca8ffac988 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:41:43.924260 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-65a20929-3005-4c00-9536-1b790d8c882e tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:41:43.924983 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-65a20929-3005-4c00-9536-1b790d8c882e tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: 59e0a2bf-716d-4e85-8332-f5ca8ffac988] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:41:43.932151 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-65a20929-3005-4c00-9536-1b790d8c882e tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:43.932595 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-65a20929-3005-4c00-9536-1b790d8c882e tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:43.933349 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-65a20929-3005-4c00-9536-1b790d8c882e tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:43.933778 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-65a20929-3005-4c00-9536-1b790d8c882e tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:44.073190 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-65a20929-3005-4c00-9536-1b790d8c882e tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab259dbcb84995aadd366f599afa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150f43b9e49a48ee9b72066f07fe95c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:41:44.080905 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-65a20929-3005-4c00-9536-1b790d8c882e tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "GET /compute/v2.1/servers/59e0a2bf-716d-4e85-8332-f5ca8ffac988" status: 200 len: 1576 microversion: 2.1 time: 0.160844 Jun 16 12:41:44.081463 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 577/1145] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:41:43 2022] GET /compute/v2.1/servers/59e0a2bf-716d-4e85-8332-f5ca8ffac988 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:41:45.101810 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3c03dd91-9806-4b20-aac7-f7a8f2feb627 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:41:45.102719 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3c03dd91-9806-4b20-aac7-f7a8f2feb627 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: 59e0a2bf-716d-4e85-8332-f5ca8ffac988] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:41:45.119180 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3c03dd91-9806-4b20-aac7-f7a8f2feb627 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:45.119832 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3c03dd91-9806-4b20-aac7-f7a8f2feb627 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:45.120569 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3c03dd91-9806-4b20-aac7-f7a8f2feb627 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:45.121288 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3c03dd91-9806-4b20-aac7-f7a8f2feb627 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:45.198075 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3c03dd91-9806-4b20-aac7-f7a8f2feb627 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab259dbcb84995aadd366f599afa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150f43b9e49a48ee9b72066f07fe95c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:41:45.205540 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3c03dd91-9806-4b20-aac7-f7a8f2feb627 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "GET /compute/v2.1/servers/59e0a2bf-716d-4e85-8332-f5ca8ffac988" status: 200 len: 1509 microversion: 2.1 time: 0.110947 Jun 16 12:41:45.206131 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 569/1146] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:41:45 2022] GET /compute/v2.1/servers/59e0a2bf-716d-4e85-8332-f5ca8ffac988 => generated 1509 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:41:45.358993 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-6d634d1e-4a9c-4bbe-956d-a010c36f20aa req-e3d0a553-4f26-402d-afad-74b19b164e4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59e0a2bf-716d-4e85-8332-f5ca8ffac988", "name": "network-vif-deleted", "tag": "02aa5db8-8b4b-41db-8938-d0c9e833052b"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:41:45.369154 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-6d634d1e-4a9c-4bbe-956d-a010c36f20aa req-e3d0a553-4f26-402d-afad-74b19b164e4b service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:45.370650 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-6d634d1e-4a9c-4bbe-956d-a010c36f20aa req-e3d0a553-4f26-402d-afad-74b19b164e4b service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:45.388963 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-6d634d1e-4a9c-4bbe-956d-a010c36f20aa req-e3d0a553-4f26-402d-afad-74b19b164e4b service nova] Creating event network-vif-deleted:02aa5db8-8b4b-41db-8938-d0c9e833052b for instance 59e0a2bf-716d-4e85-8332-f5ca8ffac988 on hv-cinder-84614 Jun 16 12:41:45.396485 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-6d634d1e-4a9c-4bbe-956d-a010c36f20aa req-e3d0a553-4f26-402d-afad-74b19b164e4b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041078 Jun 16 12:41:45.398280 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 578/1147] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:41:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 12:41:46.222216 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b080e4f0-a953-419a-9be8-a9817ea1c402 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:41:46.222915 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b080e4f0-a953-419a-9be8-a9817ea1c402 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: 59e0a2bf-716d-4e85-8332-f5ca8ffac988] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:41:46.230134 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b080e4f0-a953-419a-9be8-a9817ea1c402 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:46.230594 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b080e4f0-a953-419a-9be8-a9817ea1c402 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:46.231377 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b080e4f0-a953-419a-9be8-a9817ea1c402 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:46.231823 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b080e4f0-a953-419a-9be8-a9817ea1c402 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:46.304330 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b080e4f0-a953-419a-9be8-a9817ea1c402 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab259dbcb84995aadd366f599afa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150f43b9e49a48ee9b72066f07fe95c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:41:46.311809 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b080e4f0-a953-419a-9be8-a9817ea1c402 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "GET /compute/v2.1/servers/59e0a2bf-716d-4e85-8332-f5ca8ffac988" status: 200 len: 1224 microversion: 2.1 time: 0.093675 Jun 16 12:41:46.312379 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 570/1148] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:41:46 2022] GET /compute/v2.1/servers/59e0a2bf-716d-4e85-8332-f5ca8ffac988 => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:41:47.328845 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3bb95092-4bd4-406e-ad1a-650ee11c2b73 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:41:47.329550 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3bb95092-4bd4-406e-ad1a-650ee11c2b73 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: 59e0a2bf-716d-4e85-8332-f5ca8ffac988] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:41:47.336782 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3bb95092-4bd4-406e-ad1a-650ee11c2b73 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:47.337169 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3bb95092-4bd4-406e-ad1a-650ee11c2b73 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:47.337959 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3bb95092-4bd4-406e-ad1a-650ee11c2b73 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:47.338396 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3bb95092-4bd4-406e-ad1a-650ee11c2b73 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:47.401306 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-3bb95092-4bd4-406e-ad1a-650ee11c2b73 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab259dbcb84995aadd366f599afa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150f43b9e49a48ee9b72066f07fe95c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:41:47.408662 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3bb95092-4bd4-406e-ad1a-650ee11c2b73 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "GET /compute/v2.1/servers/59e0a2bf-716d-4e85-8332-f5ca8ffac988" status: 200 len: 1224 microversion: 2.1 time: 0.084003 Jun 16 12:41:47.409221 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 579/1149] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:41:47 2022] GET /compute/v2.1/servers/59e0a2bf-716d-4e85-8332-f5ca8ffac988 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:41:48.426013 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7de22ee6-7419-455c-82d5-27aa7c5a0473 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:41:48.427097 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7de22ee6-7419-455c-82d5-27aa7c5a0473 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: 59e0a2bf-716d-4e85-8332-f5ca8ffac988] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:41:48.433971 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7de22ee6-7419-455c-82d5-27aa7c5a0473 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:48.434419 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7de22ee6-7419-455c-82d5-27aa7c5a0473 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:48.435179 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7de22ee6-7419-455c-82d5-27aa7c5a0473 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:48.435610 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7de22ee6-7419-455c-82d5-27aa7c5a0473 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:48.505829 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7de22ee6-7419-455c-82d5-27aa7c5a0473 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab259dbcb84995aadd366f599afa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150f43b9e49a48ee9b72066f07fe95c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:41:48.513448 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7de22ee6-7419-455c-82d5-27aa7c5a0473 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "GET /compute/v2.1/servers/59e0a2bf-716d-4e85-8332-f5ca8ffac988" status: 200 len: 1224 microversion: 2.1 time: 0.091426 Jun 16 12:41:48.514054 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 571/1150] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:41:48 2022] GET /compute/v2.1/servers/59e0a2bf-716d-4e85-8332-f5ca8ffac988 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:41:49.531197 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d17201c0-b858-4c6a-ade8-059ace059aa0 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:41:49.531746 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d17201c0-b858-4c6a-ade8-059ace059aa0 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: 59e0a2bf-716d-4e85-8332-f5ca8ffac988] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:41:49.540710 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d17201c0-b858-4c6a-ade8-059ace059aa0 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:49.541243 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d17201c0-b858-4c6a-ade8-059ace059aa0 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:49.542080 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d17201c0-b858-4c6a-ade8-059ace059aa0 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:49.542675 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d17201c0-b858-4c6a-ade8-059ace059aa0 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:49.611958 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d17201c0-b858-4c6a-ade8-059ace059aa0 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab259dbcb84995aadd366f599afa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150f43b9e49a48ee9b72066f07fe95c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:41:49.619521 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d17201c0-b858-4c6a-ade8-059ace059aa0 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "GET /compute/v2.1/servers/59e0a2bf-716d-4e85-8332-f5ca8ffac988" status: 200 len: 1224 microversion: 2.1 time: 0.092208 Jun 16 12:41:49.620076 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 580/1151] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:41:49 2022] GET /compute/v2.1/servers/59e0a2bf-716d-4e85-8332-f5ca8ffac988 => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:41:50.065273 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 12:41:50.065920 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Thu Jun 16 12:41:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 12:41:50.637268 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6180f767-4a2c-4991-a591-0cb500582d26 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:41:50.637903 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6180f767-4a2c-4991-a591-0cb500582d26 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: 59e0a2bf-716d-4e85-8332-f5ca8ffac988] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:41:50.644372 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6180f767-4a2c-4991-a591-0cb500582d26 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:50.644822 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6180f767-4a2c-4991-a591-0cb500582d26 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:50.646273 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6180f767-4a2c-4991-a591-0cb500582d26 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:50.646720 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6180f767-4a2c-4991-a591-0cb500582d26 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:50.660776 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-6180f767-4a2c-4991-a591-0cb500582d26 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] HTTP exception thrown: Instance 59e0a2bf-716d-4e85-8332-f5ca8ffac988 could not be found. Jun 16 12:41:50.662437 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6180f767-4a2c-4991-a591-0cb500582d26 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Request method failure captured: Jun 16 12:41:50.662437 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: request: GET /compute/v2.1/servers/59e0a2bf-716d-4e85-8332-f5ca8ffac988 HTTP/1.1 Jun 16 12:41:50.662437 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 16 12:41:50.662437 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 16 12:41:50.662437 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Connection: close Jun 16 12:41:50.662437 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 16 12:41:50.662437 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 16 12:41:50.662437 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Host: 10.222.0.45 Jun 16 12:41:50.662437 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 16 12:41:50.662437 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 16 12:41:50.662437 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABiqyRCVe1nO68hUC5nq5ZPKCn6diHqewjzZl_C0p-GDE0Qhc-3c8ZV5ouJSCgffRyWnI2QsBhNAO7XnfqW1aXeSIvVyZcZugaGGH8Q96UIBSpSxOv54KQsxGK3lSGrnP1wKkKE85DLIY_AKghOggAiE6RcKLStKgScpvdSjpRGC5UwgeY Jun 16 12:41:50.662437 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 16 12:41:50.662437 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 16 12:41:50.662437 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 16 12:41:50.662437 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 16 12:41:50.662437 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 16 12:41:50.662437 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 16 12:41:50.662437 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Id: 150f43b9e49a48ee9b72066f07fe95c4 Jun 16 12:41:50.662437 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-TestVolumeBootPattern-1888988749 Jun 16 12:41:50.662437 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 16 12:41:50.662437 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 16 12:41:50.664002 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/150f43b9e49a48ee9b72066f07fe95c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/150f43b9e49a48ee9b72066f07fe95c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_150f43b9e49a48ee9b72066f07fe95c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/150f43b9e49a48ee9b72066f07fe95c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Jun 16 12:41:50.664002 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-TestVolumeBootPattern-1888988749 Jun 16 12:41:50.664002 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 150f43b9e49a48ee9b72066f07fe95c4 Jun 16 12:41:50.664002 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-TestVolumeBootPattern-1888988749 Jun 16 12:41:50.664002 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User: tempest-TestVolumeBootPattern-1888988749-project Jun 16 12:41:50.664002 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 16 12:41:50.664002 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 16 12:41:50.664002 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Id: 7cab259dbcb84995aadd366f599afa06 Jun 16 12:41:50.664002 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-TestVolumeBootPattern-1888988749-project Jun 16 12:41:50.664002 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: method: > Jun 16 12:41:50.664002 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: exception: Instance 59e0a2bf-716d-4e85-8332-f5ca8ffac988 could not be found. Jun 16 12:41:50.664002 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: action_args: {'id': '59e0a2bf-716d-4e85-8332-f5ca8ffac988'} Jun 16 12:41:50.664899 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:41:50.664899 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:41:50.664899 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:41:50.664899 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:41:50.664899 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:41:50.664899 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:41:50.664899 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:41:50.664899 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:41:50.664899 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:41:50.664899 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:41:50.664899 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59e0a2bf-716d-4e85-8332-f5ca8ffac988 could not be found. Jun 16 12:41:50.664899 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:41:50.664899 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:41:50.664899 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:41:50.664899 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:41:50.664899 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:41:50.664899 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:41:50.664899 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:41:50.664899 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:41:50.664899 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:41:50.667048 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:41:50.667048 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 12:41:50.667048 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 12:41:50.667048 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:41:50.667048 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:41:50.667048 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:41:50.667048 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:41:50.667048 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59e0a2bf-716d-4e85-8332-f5ca8ffac988 could not be found. Jun 16 12:41:50.667048 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:41:50.667048 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:41:50.667048 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:41:50.667048 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:41:50.667048 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:41:50.667048 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:41:50.667048 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:41:50.667048 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:41:50.667048 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59e0a2bf-716d-4e85-8332-f5ca8ffac988 could not be found. Jun 16 12:41:50.667048 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:41:50.668420 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6180f767-4a2c-4991-a591-0cb500582d26 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Returning 404 to user: Instance 59e0a2bf-716d-4e85-8332-f5ca8ffac988 could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:41:50.668420 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6180f767-4a2c-4991-a591-0cb500582d26 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "GET /compute/v2.1/servers/59e0a2bf-716d-4e85-8332-f5ca8ffac988" status: 404 len: 111 microversion: 2.1 time: 0.032084 Jun 16 12:41:50.668420 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 572/1152] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:41:50 2022] GET /compute/v2.1/servers/59e0a2bf-716d-4e85-8332-f5ca8ffac988 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 12:41:50.772079 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c9a6c1bf-a0e4-4207-9736-aa5bd0a1ecf5 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1769553292", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-176952666", "security_groups": [{"name": "tempest-secgroup-smoke-766533995"}], "block_device_mapping_v2": [{"uuid": "4938186a-ccf7-4717-b35b-d1c22989176a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "124cf41f-adc1-4007-8672-e5b44992e6b1"}]}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:41:50.890128 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.network.neutron [None req-c9a6c1bf-a0e4-4207-9736-aa5bd0a1ecf5 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] validate_networks() for [('124cf41f-adc1-4007-8672-e5b44992e6b1', None, None, None, None, None)] {{(pid=117607) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 12:41:51.269706 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-c9a6c1bf-a0e4-4207-9736-aa5bd0a1ecf5 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Flavor limits 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 12:41:51.270179 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-c9a6c1bf-a0e4-4207-9736-aa5bd0a1ecf5 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Image limits 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 12:41:51.270665 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-c9a6c1bf-a0e4-4207-9736-aa5bd0a1ecf5 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Flavor pref 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 12:41:51.271072 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-c9a6c1bf-a0e4-4207-9736-aa5bd0a1ecf5 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Image pref 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 12:41:51.271495 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-c9a6c1bf-a0e4-4207-9736-aa5bd0a1ecf5 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 12:41:51.280603 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c9a6c1bf-a0e4-4207-9736-aa5bd0a1ecf5 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:51.281055 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c9a6c1bf-a0e4-4207-9736-aa5bd0a1ecf5 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:51.281894 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c9a6c1bf-a0e4-4207-9736-aa5bd0a1ecf5 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:51.282334 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c9a6c1bf-a0e4-4207-9736-aa5bd0a1ecf5 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:51.298708 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-c9a6c1bf-a0e4-4207-9736-aa5bd0a1ecf5 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Getting quotas for project 150f43b9e49a48ee9b72066f07fe95c4. Resources: {'instances', 'cores', 'ram'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 12:41:51.303138 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-c9a6c1bf-a0e4-4207-9736-aa5bd0a1ecf5 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Getting quotas for user 7cab259dbcb84995aadd366f599afa06 and project 150f43b9e49a48ee9b72066f07fe95c4. Resources: {'instances', 'cores', 'ram'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 12:41:51.359963 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c9a6c1bf-a0e4-4207-9736-aa5bd0a1ecf5 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Going to run 1 instances... {{(pid=117607) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 12:41:51.362072 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c9a6c1bf-a0e4-4207-9736-aa5bd0a1ecf5 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: 2870520c-7049-4b01-8f69-f3c71edd419b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4938186a-ccf7-4717-b35b-d1c22989176a',volume_size=None,volume_type=None)] {{(pid=117607) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 12:41:51.487181 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c9a6c1bf-a0e4-4207-9736-aa5bd0a1ecf5 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.720156 Jun 16 12:41:51.487827 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 581/1153] 10.222.0.45 () {60 vars in 1146 bytes} [Thu Jun 16 12:41:50 2022] POST /compute/v2.1/servers => generated 405 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 12:41:51.498165 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8644d4f4-a835-419d-b9f8-1825fc729b3d tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:41:51.498785 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8644d4f4-a835-419d-b9f8-1825fc729b3d tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: 2870520c-7049-4b01-8f69-f3c71edd419b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:41:51.551159 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8644d4f4-a835-419d-b9f8-1825fc729b3d tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab259dbcb84995aadd366f599afa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150f43b9e49a48ee9b72066f07fe95c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:41:51.558559 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8644d4f4-a835-419d-b9f8-1825fc729b3d tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "GET /compute/v2.1/servers/2870520c-7049-4b01-8f69-f3c71edd419b" status: 200 len: 1094 microversion: 2.1 time: 0.064170 Jun 16 12:41:51.559127 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 573/1154] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:41:51 2022] GET /compute/v2.1/servers/2870520c-7049-4b01-8f69-f3c71edd419b => generated 1094 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:41:52.575885 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-99bff251-211c-4e1d-b440-c4a3924e2152 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:41:52.576599 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-99bff251-211c-4e1d-b440-c4a3924e2152 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: 2870520c-7049-4b01-8f69-f3c71edd419b] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:41:52.584404 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-99bff251-211c-4e1d-b440-c4a3924e2152 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:52.584873 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-99bff251-211c-4e1d-b440-c4a3924e2152 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:52.585628 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-99bff251-211c-4e1d-b440-c4a3924e2152 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:52.586101 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-99bff251-211c-4e1d-b440-c4a3924e2152 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:52.661786 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-99bff251-211c-4e1d-b440-c4a3924e2152 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab259dbcb84995aadd366f599afa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150f43b9e49a48ee9b72066f07fe95c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:41:52.669718 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-99bff251-211c-4e1d-b440-c4a3924e2152 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "GET /compute/v2.1/servers/2870520c-7049-4b01-8f69-f3c71edd419b" status: 200 len: 1210 microversion: 2.1 time: 0.098126 Jun 16 12:41:52.670622 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 582/1155] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:41:52 2022] GET /compute/v2.1/servers/2870520c-7049-4b01-8f69-f3c71edd419b => generated 1210 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:41:53.687993 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d9359438-0cca-4f7e-975f-8603340e254d tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:41:53.689435 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d9359438-0cca-4f7e-975f-8603340e254d tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: 2870520c-7049-4b01-8f69-f3c71edd419b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:41:53.698340 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d9359438-0cca-4f7e-975f-8603340e254d tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:53.698883 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d9359438-0cca-4f7e-975f-8603340e254d tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:53.699633 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d9359438-0cca-4f7e-975f-8603340e254d tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:53.700131 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d9359438-0cca-4f7e-975f-8603340e254d tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:53.906299 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d9359438-0cca-4f7e-975f-8603340e254d tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab259dbcb84995aadd366f599afa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150f43b9e49a48ee9b72066f07fe95c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:41:53.915615 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d9359438-0cca-4f7e-975f-8603340e254d tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "GET /compute/v2.1/servers/2870520c-7049-4b01-8f69-f3c71edd419b" status: 200 len: 1265 microversion: 2.1 time: 0.232561 Jun 16 12:41:53.916539 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 574/1156] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:41:53 2022] GET /compute/v2.1/servers/2870520c-7049-4b01-8f69-f3c71edd419b => generated 1265 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:41:53.966711 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-77678625-3478-490c-9ec0-78cfa34ec413 req-32d26b7c-4687-4153-8f89-ef4f8b8dea9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2870520c-7049-4b01-8f69-f3c71edd419b", "tag": "8644c704-7078-4a92-bece-7470a7104c7f"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:41:53.983268 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-77678625-3478-490c-9ec0-78cfa34ec413 req-32d26b7c-4687-4153-8f89-ef4f8b8dea9b service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:53.983717 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-77678625-3478-490c-9ec0-78cfa34ec413 req-32d26b7c-4687-4153-8f89-ef4f8b8dea9b service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:53.996950 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-77678625-3478-490c-9ec0-78cfa34ec413 req-32d26b7c-4687-4153-8f89-ef4f8b8dea9b service nova] Creating event network-changed:8644c704-7078-4a92-bece-7470a7104c7f for instance 2870520c-7049-4b01-8f69-f3c71edd419b on hv-cinder-84614 Jun 16 12:41:54.002370 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-77678625-3478-490c-9ec0-78cfa34ec413 req-32d26b7c-4687-4153-8f89-ef4f8b8dea9b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044927 Jun 16 12:41:54.003585 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 583/1157] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:41:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:41:54.932956 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2794a7bb-ec65-426d-99e0-d3974cd1d769 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:41:54.933562 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2794a7bb-ec65-426d-99e0-d3974cd1d769 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: 2870520c-7049-4b01-8f69-f3c71edd419b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:41:54.940013 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2794a7bb-ec65-426d-99e0-d3974cd1d769 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:54.940467 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2794a7bb-ec65-426d-99e0-d3974cd1d769 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:54.941236 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2794a7bb-ec65-426d-99e0-d3974cd1d769 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:54.941682 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2794a7bb-ec65-426d-99e0-d3974cd1d769 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:55.077501 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2794a7bb-ec65-426d-99e0-d3974cd1d769 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab259dbcb84995aadd366f599afa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150f43b9e49a48ee9b72066f07fe95c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:41:55.085839 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2794a7bb-ec65-426d-99e0-d3974cd1d769 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "GET /compute/v2.1/servers/2870520c-7049-4b01-8f69-f3c71edd419b" status: 200 len: 1265 microversion: 2.1 time: 0.156805 Jun 16 12:41:55.086676 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 575/1158] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:41:54 2022] GET /compute/v2.1/servers/2870520c-7049-4b01-8f69-f3c71edd419b => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:41:56.104434 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a40f60ce-19d7-4ee1-9cba-82990a8e20a7 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:41:56.105130 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a40f60ce-19d7-4ee1-9cba-82990a8e20a7 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: 2870520c-7049-4b01-8f69-f3c71edd419b] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:41:56.113286 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a40f60ce-19d7-4ee1-9cba-82990a8e20a7 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:56.113798 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a40f60ce-19d7-4ee1-9cba-82990a8e20a7 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:56.115084 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a40f60ce-19d7-4ee1-9cba-82990a8e20a7 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:56.115996 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a40f60ce-19d7-4ee1-9cba-82990a8e20a7 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:56.254667 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a40f60ce-19d7-4ee1-9cba-82990a8e20a7 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab259dbcb84995aadd366f599afa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150f43b9e49a48ee9b72066f07fe95c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:41:56.262307 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a40f60ce-19d7-4ee1-9cba-82990a8e20a7 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "GET /compute/v2.1/servers/2870520c-7049-4b01-8f69-f3c71edd419b" status: 200 len: 1265 microversion: 2.1 time: 0.163181 Jun 16 12:41:56.262857 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 584/1159] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:41:56 2022] GET /compute/v2.1/servers/2870520c-7049-4b01-8f69-f3c71edd419b => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:41:57.279705 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2f957b3b-02b8-40b8-b991-ec17a25fea3e tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:41:57.280329 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2f957b3b-02b8-40b8-b991-ec17a25fea3e tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: 2870520c-7049-4b01-8f69-f3c71edd419b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:41:57.287228 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2f957b3b-02b8-40b8-b991-ec17a25fea3e tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:57.287735 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2f957b3b-02b8-40b8-b991-ec17a25fea3e tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:57.288513 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2f957b3b-02b8-40b8-b991-ec17a25fea3e tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:57.288959 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2f957b3b-02b8-40b8-b991-ec17a25fea3e tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:57.435088 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2f957b3b-02b8-40b8-b991-ec17a25fea3e tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab259dbcb84995aadd366f599afa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150f43b9e49a48ee9b72066f07fe95c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:41:57.442717 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2f957b3b-02b8-40b8-b991-ec17a25fea3e tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "GET /compute/v2.1/servers/2870520c-7049-4b01-8f69-f3c71edd419b" status: 200 len: 1265 microversion: 2.1 time: 0.166973 Jun 16 12:41:57.444028 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 576/1160] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:41:57 2022] GET /compute/v2.1/servers/2870520c-7049-4b01-8f69-f3c71edd419b => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:41:58.460508 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-991805ba-b9d5-4cd7-9168-f95a39c771f8 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:41:58.461118 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-991805ba-b9d5-4cd7-9168-f95a39c771f8 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: 2870520c-7049-4b01-8f69-f3c71edd419b] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:41:58.467564 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-991805ba-b9d5-4cd7-9168-f95a39c771f8 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:58.468009 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-991805ba-b9d5-4cd7-9168-f95a39c771f8 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:58.468760 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-991805ba-b9d5-4cd7-9168-f95a39c771f8 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:58.469193 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-991805ba-b9d5-4cd7-9168-f95a39c771f8 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:58.600766 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-991805ba-b9d5-4cd7-9168-f95a39c771f8 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab259dbcb84995aadd366f599afa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150f43b9e49a48ee9b72066f07fe95c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:41:58.608344 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-991805ba-b9d5-4cd7-9168-f95a39c771f8 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "GET /compute/v2.1/servers/2870520c-7049-4b01-8f69-f3c71edd419b" status: 200 len: 1265 microversion: 2.1 time: 0.152661 Jun 16 12:41:58.615820 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 585/1161] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:41:58 2022] GET /compute/v2.1/servers/2870520c-7049-4b01-8f69-f3c71edd419b => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:41:59.625733 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-cbd03a29-e8fd-4924-b745-1f0de3a92a9a tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:41:59.626297 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-cbd03a29-e8fd-4924-b745-1f0de3a92a9a tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: 2870520c-7049-4b01-8f69-f3c71edd419b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:41:59.633341 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cbd03a29-e8fd-4924-b745-1f0de3a92a9a tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:59.633781 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cbd03a29-e8fd-4924-b745-1f0de3a92a9a tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:59.634557 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cbd03a29-e8fd-4924-b745-1f0de3a92a9a tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:41:59.634986 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cbd03a29-e8fd-4924-b745-1f0de3a92a9a tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:41:59.768848 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-cbd03a29-e8fd-4924-b745-1f0de3a92a9a tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab259dbcb84995aadd366f599afa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150f43b9e49a48ee9b72066f07fe95c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:41:59.777081 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-cbd03a29-e8fd-4924-b745-1f0de3a92a9a tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "GET /compute/v2.1/servers/2870520c-7049-4b01-8f69-f3c71edd419b" status: 200 len: 1265 microversion: 2.1 time: 0.155320 Jun 16 12:41:59.777638 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 577/1162] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:41:59 2022] GET /compute/v2.1/servers/2870520c-7049-4b01-8f69-f3c71edd419b => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:42:00.793318 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-40ff2089-87c4-4a29-a138-d52c6f5b6f6f tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:42:00.793978 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-40ff2089-87c4-4a29-a138-d52c6f5b6f6f tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: 2870520c-7049-4b01-8f69-f3c71edd419b] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:42:00.800425 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-40ff2089-87c4-4a29-a138-d52c6f5b6f6f tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:42:00.800871 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-40ff2089-87c4-4a29-a138-d52c6f5b6f6f tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:42:00.801632 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-40ff2089-87c4-4a29-a138-d52c6f5b6f6f tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:42:00.802682 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-40ff2089-87c4-4a29-a138-d52c6f5b6f6f tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:42:00.932203 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-40ff2089-87c4-4a29-a138-d52c6f5b6f6f tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab259dbcb84995aadd366f599afa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150f43b9e49a48ee9b72066f07fe95c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:42:00.940020 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-40ff2089-87c4-4a29-a138-d52c6f5b6f6f tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "GET /compute/v2.1/servers/2870520c-7049-4b01-8f69-f3c71edd419b" status: 200 len: 1265 microversion: 2.1 time: 0.150559 Jun 16 12:42:00.940577 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 586/1163] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:42:00 2022] GET /compute/v2.1/servers/2870520c-7049-4b01-8f69-f3c71edd419b => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:42:01.956837 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-371a0241-d3bd-4fed-b84a-41169ca2b1de tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:42:01.957362 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-371a0241-d3bd-4fed-b84a-41169ca2b1de tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: 2870520c-7049-4b01-8f69-f3c71edd419b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:42:01.960827 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=2 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:42:01.966761 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-371a0241-d3bd-4fed-b84a-41169ca2b1de tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:42:01.967204 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-371a0241-d3bd-4fed-b84a-41169ca2b1de tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:42:01.967965 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-371a0241-d3bd-4fed-b84a-41169ca2b1de tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:42:01.968398 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-371a0241-d3bd-4fed-b84a-41169ca2b1de tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:42:02.100567 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-371a0241-d3bd-4fed-b84a-41169ca2b1de tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab259dbcb84995aadd366f599afa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150f43b9e49a48ee9b72066f07fe95c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:42:02.107909 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-371a0241-d3bd-4fed-b84a-41169ca2b1de tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "GET /compute/v2.1/servers/2870520c-7049-4b01-8f69-f3c71edd419b" status: 200 len: 1265 microversion: 2.1 time: 0.155078 Jun 16 12:42:02.108463 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 578/1164] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:42:01 2022] GET /compute/v2.1/servers/2870520c-7049-4b01-8f69-f3c71edd419b => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:42:03.125362 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a4cace07-a4da-418b-9296-8dc09b34a40d tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:42:03.126024 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a4cace07-a4da-418b-9296-8dc09b34a40d tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: 2870520c-7049-4b01-8f69-f3c71edd419b] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:42:03.127967 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell0:SELECT=2 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:42:03.128637 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell0:SELECT=6 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:42:03.136157 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a4cace07-a4da-418b-9296-8dc09b34a40d tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:42:03.136610 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a4cace07-a4da-418b-9296-8dc09b34a40d tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:42:03.137376 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a4cace07-a4da-418b-9296-8dc09b34a40d tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:42:03.137820 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a4cace07-a4da-418b-9296-8dc09b34a40d tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:42:03.269351 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a4cace07-a4da-418b-9296-8dc09b34a40d tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab259dbcb84995aadd366f599afa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150f43b9e49a48ee9b72066f07fe95c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:42:03.277731 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a4cace07-a4da-418b-9296-8dc09b34a40d tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "GET /compute/v2.1/servers/2870520c-7049-4b01-8f69-f3c71edd419b" status: 200 len: 1265 microversion: 2.1 time: 0.156275 Jun 16 12:42:03.278334 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 587/1165] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:42:03 2022] GET /compute/v2.1/servers/2870520c-7049-4b01-8f69-f3c71edd419b => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:42:04.294691 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3699d8f8-7e02-4aff-bcf9-750910be3468 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:42:04.295335 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3699d8f8-7e02-4aff-bcf9-750910be3468 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: 2870520c-7049-4b01-8f69-f3c71edd419b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:42:04.301756 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3699d8f8-7e02-4aff-bcf9-750910be3468 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:42:04.302231 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3699d8f8-7e02-4aff-bcf9-750910be3468 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:42:04.302986 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3699d8f8-7e02-4aff-bcf9-750910be3468 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:42:04.303422 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3699d8f8-7e02-4aff-bcf9-750910be3468 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:42:04.593894 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3699d8f8-7e02-4aff-bcf9-750910be3468 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab259dbcb84995aadd366f599afa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150f43b9e49a48ee9b72066f07fe95c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:42:04.602419 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3699d8f8-7e02-4aff-bcf9-750910be3468 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "GET /compute/v2.1/servers/2870520c-7049-4b01-8f69-f3c71edd419b" status: 200 len: 1265 microversion: 2.1 time: 0.311616 Jun 16 12:42:04.602973 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 579/1166] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:42:04 2022] GET /compute/v2.1/servers/2870520c-7049-4b01-8f69-f3c71edd419b => generated 1265 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:42:05.620016 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d9a01222-afb1-4d79-88d2-09583081e12d tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:42:05.620549 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d9a01222-afb1-4d79-88d2-09583081e12d tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: 2870520c-7049-4b01-8f69-f3c71edd419b] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:42:05.627043 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d9a01222-afb1-4d79-88d2-09583081e12d tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:42:05.627487 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d9a01222-afb1-4d79-88d2-09583081e12d tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:42:05.628243 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d9a01222-afb1-4d79-88d2-09583081e12d tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:42:05.628670 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d9a01222-afb1-4d79-88d2-09583081e12d tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:42:05.760332 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d9a01222-afb1-4d79-88d2-09583081e12d tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab259dbcb84995aadd366f599afa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150f43b9e49a48ee9b72066f07fe95c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:42:05.767723 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d9a01222-afb1-4d79-88d2-09583081e12d tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "GET /compute/v2.1/servers/2870520c-7049-4b01-8f69-f3c71edd419b" status: 200 len: 1265 microversion: 2.1 time: 0.152735 Jun 16 12:42:05.768291 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 588/1167] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:42:05 2022] GET /compute/v2.1/servers/2870520c-7049-4b01-8f69-f3c71edd419b => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:42:06.487628 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-5f45744d-d874-4fa4-835d-fe20b750a0fb req-9ecda0ce-66ef-48b0-96e7-df2be3eb838d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2870520c-7049-4b01-8f69-f3c71edd419b", "name": "network-vif-plugged", "status": "completed", "tag": "8644c704-7078-4a92-bece-7470a7104c7f"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:42:06.497207 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-5f45744d-d874-4fa4-835d-fe20b750a0fb req-9ecda0ce-66ef-48b0-96e7-df2be3eb838d service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:42:06.497652 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-5f45744d-d874-4fa4-835d-fe20b750a0fb req-9ecda0ce-66ef-48b0-96e7-df2be3eb838d service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:42:06.509857 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-5f45744d-d874-4fa4-835d-fe20b750a0fb req-9ecda0ce-66ef-48b0-96e7-df2be3eb838d service nova] Creating event network-vif-plugged:8644c704-7078-4a92-bece-7470a7104c7f for instance 2870520c-7049-4b01-8f69-f3c71edd419b on hv-cinder-84614 Jun 16 12:42:06.514759 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-5f45744d-d874-4fa4-835d-fe20b750a0fb req-9ecda0ce-66ef-48b0-96e7-df2be3eb838d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030861 Jun 16 12:42:06.515353 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 580/1168] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:42:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:42:06.785956 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-950f921a-323b-458e-815f-708e19d0408c tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:42:06.786911 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-950f921a-323b-458e-815f-708e19d0408c tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: 2870520c-7049-4b01-8f69-f3c71edd419b] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:42:06.795172 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-950f921a-323b-458e-815f-708e19d0408c tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:42:06.795643 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-950f921a-323b-458e-815f-708e19d0408c tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:42:06.796386 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-950f921a-323b-458e-815f-708e19d0408c tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:42:06.796816 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-950f921a-323b-458e-815f-708e19d0408c tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:42:06.927822 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-950f921a-323b-458e-815f-708e19d0408c tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab259dbcb84995aadd366f599afa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150f43b9e49a48ee9b72066f07fe95c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:42:06.935277 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-950f921a-323b-458e-815f-708e19d0408c tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "GET /compute/v2.1/servers/2870520c-7049-4b01-8f69-f3c71edd419b" status: 200 len: 1265 microversion: 2.1 time: 0.154510 Jun 16 12:42:06.935847 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 589/1169] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:42:06 2022] GET /compute/v2.1/servers/2870520c-7049-4b01-8f69-f3c71edd419b => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:42:07.953271 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2b00f195-0aed-410f-b1b2-c1cadf923890 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:42:07.954028 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2b00f195-0aed-410f-b1b2-c1cadf923890 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: 2870520c-7049-4b01-8f69-f3c71edd419b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:42:07.961147 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2b00f195-0aed-410f-b1b2-c1cadf923890 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:42:07.961691 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2b00f195-0aed-410f-b1b2-c1cadf923890 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:42:07.962474 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2b00f195-0aed-410f-b1b2-c1cadf923890 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:42:07.962903 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2b00f195-0aed-410f-b1b2-c1cadf923890 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:42:08.094551 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2b00f195-0aed-410f-b1b2-c1cadf923890 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab259dbcb84995aadd366f599afa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150f43b9e49a48ee9b72066f07fe95c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:42:08.102678 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2b00f195-0aed-410f-b1b2-c1cadf923890 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "GET /compute/v2.1/servers/2870520c-7049-4b01-8f69-f3c71edd419b" status: 200 len: 1265 microversion: 2.1 time: 0.154096 Jun 16 12:42:08.103249 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 581/1170] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:42:07 2022] GET /compute/v2.1/servers/2870520c-7049-4b01-8f69-f3c71edd419b => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:42:09.120462 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-96441ec3-cc77-4e83-8d8c-802f18310a62 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:42:09.121080 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-96441ec3-cc77-4e83-8d8c-802f18310a62 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: 2870520c-7049-4b01-8f69-f3c71edd419b] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:42:09.127309 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-96441ec3-cc77-4e83-8d8c-802f18310a62 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:42:09.127764 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-96441ec3-cc77-4e83-8d8c-802f18310a62 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:42:09.128525 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-96441ec3-cc77-4e83-8d8c-802f18310a62 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:42:09.128964 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-96441ec3-cc77-4e83-8d8c-802f18310a62 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:42:09.255884 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-96441ec3-cc77-4e83-8d8c-802f18310a62 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab259dbcb84995aadd366f599afa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150f43b9e49a48ee9b72066f07fe95c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:42:09.263401 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-96441ec3-cc77-4e83-8d8c-802f18310a62 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "GET /compute/v2.1/servers/2870520c-7049-4b01-8f69-f3c71edd419b" status: 200 len: 1265 microversion: 2.1 time: 0.147574 Jun 16 12:42:09.264096 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 590/1171] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:42:09 2022] GET /compute/v2.1/servers/2870520c-7049-4b01-8f69-f3c71edd419b => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:42:10.281585 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e8934532-2317-49ba-bba2-d3caf9c398a6 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:42:10.282161 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e8934532-2317-49ba-bba2-d3caf9c398a6 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: 2870520c-7049-4b01-8f69-f3c71edd419b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:42:10.289248 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e8934532-2317-49ba-bba2-d3caf9c398a6 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:42:10.289694 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e8934532-2317-49ba-bba2-d3caf9c398a6 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:42:10.290483 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e8934532-2317-49ba-bba2-d3caf9c398a6 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:42:10.290920 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e8934532-2317-49ba-bba2-d3caf9c398a6 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:42:10.422509 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e8934532-2317-49ba-bba2-d3caf9c398a6 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab259dbcb84995aadd366f599afa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150f43b9e49a48ee9b72066f07fe95c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:42:10.430586 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e8934532-2317-49ba-bba2-d3caf9c398a6 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "GET /compute/v2.1/servers/2870520c-7049-4b01-8f69-f3c71edd419b" status: 200 len: 1265 microversion: 2.1 time: 0.153048 Jun 16 12:42:10.431159 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 582/1172] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:42:10 2022] GET /compute/v2.1/servers/2870520c-7049-4b01-8f69-f3c71edd419b => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:42:11.447497 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b170ab54-7a89-4296-9851-1fbb229be1ef tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:42:11.448109 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b170ab54-7a89-4296-9851-1fbb229be1ef tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: 2870520c-7049-4b01-8f69-f3c71edd419b] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:42:11.454545 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b170ab54-7a89-4296-9851-1fbb229be1ef tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:42:11.454989 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b170ab54-7a89-4296-9851-1fbb229be1ef tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:42:11.455742 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b170ab54-7a89-4296-9851-1fbb229be1ef tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:42:11.456173 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b170ab54-7a89-4296-9851-1fbb229be1ef tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:42:11.585112 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b170ab54-7a89-4296-9851-1fbb229be1ef tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab259dbcb84995aadd366f599afa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150f43b9e49a48ee9b72066f07fe95c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:42:11.592694 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b170ab54-7a89-4296-9851-1fbb229be1ef tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "GET /compute/v2.1/servers/2870520c-7049-4b01-8f69-f3c71edd419b" status: 200 len: 1265 microversion: 2.1 time: 0.150140 Jun 16 12:42:11.593261 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 591/1173] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:42:11 2022] GET /compute/v2.1/servers/2870520c-7049-4b01-8f69-f3c71edd419b => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:42:12.136370 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 12:42:12.136590 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Thu Jun 16 12:42:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 12:42:12.609387 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-43f5dd6b-95d0-49d1-9df3-e73ff0fb4402 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:42:12.610037 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-43f5dd6b-95d0-49d1-9df3-e73ff0fb4402 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: 2870520c-7049-4b01-8f69-f3c71edd419b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:42:12.617334 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-43f5dd6b-95d0-49d1-9df3-e73ff0fb4402 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:42:12.617782 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-43f5dd6b-95d0-49d1-9df3-e73ff0fb4402 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:42:12.618570 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-43f5dd6b-95d0-49d1-9df3-e73ff0fb4402 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:42:12.619009 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-43f5dd6b-95d0-49d1-9df3-e73ff0fb4402 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:42:13.010093 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-43f5dd6b-95d0-49d1-9df3-e73ff0fb4402 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab259dbcb84995aadd366f599afa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150f43b9e49a48ee9b72066f07fe95c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:42:13.012501 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=80 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:42:13.019011 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-43f5dd6b-95d0-49d1-9df3-e73ff0fb4402 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "GET /compute/v2.1/servers/2870520c-7049-4b01-8f69-f3c71edd419b" status: 200 len: 1265 microversion: 2.1 time: 0.413562 Jun 16 12:42:13.019560 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 583/1174] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:42:12 2022] GET /compute/v2.1/servers/2870520c-7049-4b01-8f69-f3c71edd419b => generated 1265 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:42:14.035587 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8dced445-1765-4683-aedd-227195159545 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:42:14.036203 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8dced445-1765-4683-aedd-227195159545 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: 2870520c-7049-4b01-8f69-f3c71edd419b] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:42:14.039276 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:42:14.044818 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8dced445-1765-4683-aedd-227195159545 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:42:14.045269 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8dced445-1765-4683-aedd-227195159545 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:42:14.046063 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8dced445-1765-4683-aedd-227195159545 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:42:14.046558 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8dced445-1765-4683-aedd-227195159545 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:42:14.052159 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:42:14.184592 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8dced445-1765-4683-aedd-227195159545 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab259dbcb84995aadd366f599afa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150f43b9e49a48ee9b72066f07fe95c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:42:14.195404 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8dced445-1765-4683-aedd-227195159545 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "GET /compute/v2.1/servers/2870520c-7049-4b01-8f69-f3c71edd419b" status: 200 len: 1453 microversion: 2.1 time: 0.163423 Jun 16 12:42:14.196329 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 592/1175] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:42:14 2022] GET /compute/v2.1/servers/2870520c-7049-4b01-8f69-f3c71edd419b => generated 1453 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:42:14.212088 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6748ea4a-ebce-4326-a69e-2cf9d320d5e5 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:42:14.212705 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6748ea4a-ebce-4326-a69e-2cf9d320d5e5 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: 2870520c-7049-4b01-8f69-f3c71edd419b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:42:14.215295 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=34 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:42:14.220691 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6748ea4a-ebce-4326-a69e-2cf9d320d5e5 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:42:14.221144 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6748ea4a-ebce-4326-a69e-2cf9d320d5e5 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:42:14.221938 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6748ea4a-ebce-4326-a69e-2cf9d320d5e5 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:42:14.222431 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6748ea4a-ebce-4326-a69e-2cf9d320d5e5 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:42:14.361426 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6748ea4a-ebce-4326-a69e-2cf9d320d5e5 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab259dbcb84995aadd366f599afa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150f43b9e49a48ee9b72066f07fe95c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:42:14.369976 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6748ea4a-ebce-4326-a69e-2cf9d320d5e5 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "GET /compute/v2.1/servers/2870520c-7049-4b01-8f69-f3c71edd419b" status: 200 len: 1453 microversion: 2.1 time: 0.161851 Jun 16 12:42:14.370433 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 584/1176] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:42:14 2022] GET /compute/v2.1/servers/2870520c-7049-4b01-8f69-f3c71edd419b => generated 1453 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:42:16.244519 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-8e42ffc2-9980-4ec9-8235-c0765e19fbca req-5e88f19f-dc2a-437d-bdfe-e2d3f670ab65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2870520c-7049-4b01-8f69-f3c71edd419b", "tag": "8644c704-7078-4a92-bece-7470a7104c7f"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:42:16.252640 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-8e42ffc2-9980-4ec9-8235-c0765e19fbca req-5e88f19f-dc2a-437d-bdfe-e2d3f670ab65 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:42:16.253005 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-8e42ffc2-9980-4ec9-8235-c0765e19fbca req-5e88f19f-dc2a-437d-bdfe-e2d3f670ab65 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:42:16.265119 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-8e42ffc2-9980-4ec9-8235-c0765e19fbca req-5e88f19f-dc2a-437d-bdfe-e2d3f670ab65 service nova] Creating event network-changed:8644c704-7078-4a92-bece-7470a7104c7f for instance 2870520c-7049-4b01-8f69-f3c71edd419b on hv-cinder-84614 Jun 16 12:42:16.270915 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-8e42ffc2-9980-4ec9-8235-c0765e19fbca req-5e88f19f-dc2a-437d-bdfe-e2d3f670ab65 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091858 Jun 16 12:42:16.271549 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 593/1177] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:42:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:44:25.417135 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1d291c8a-58bf-4bfa-ba68-bf67536e2e47] AMQP server on 10.222.0.45:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 16 12:44:25.417701 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:44:25.418656 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=7 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:44:25.423117 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e28b03c3-94c2-4c9f-bb43-72c9f7e961b5 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-51487756", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-176952666", "security_groups": [{"name": "tempest-secgroup-smoke-766533995"}], "block_device_mapping_v2": [{"uuid": "2817876f-12c6-495b-b173-161d94b56482", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "124cf41f-adc1-4007-8672-e5b44992e6b1"}]}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:44:25.538218 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.network.neutron [None req-e28b03c3-94c2-4c9f-bb43-72c9f7e961b5 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] validate_networks() for [('124cf41f-adc1-4007-8672-e5b44992e6b1', None, None, None, None, None)] {{(pid=117606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 12:44:25.989226 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-e28b03c3-94c2-4c9f-bb43-72c9f7e961b5 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Flavor limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 12:44:25.989651 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-e28b03c3-94c2-4c9f-bb43-72c9f7e961b5 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Image limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 12:44:25.990150 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-e28b03c3-94c2-4c9f-bb43-72c9f7e961b5 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Flavor pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 12:44:25.990560 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-e28b03c3-94c2-4c9f-bb43-72c9f7e961b5 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Image pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 12:44:25.990965 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-e28b03c3-94c2-4c9f-bb43-72c9f7e961b5 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 12:44:25.999880 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e28b03c3-94c2-4c9f-bb43-72c9f7e961b5 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:44:26.000329 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e28b03c3-94c2-4c9f-bb43-72c9f7e961b5 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:44:26.001159 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e28b03c3-94c2-4c9f-bb43-72c9f7e961b5 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:44:26.002203 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e28b03c3-94c2-4c9f-bb43-72c9f7e961b5 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:44:26.019420 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-e28b03c3-94c2-4c9f-bb43-72c9f7e961b5 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Getting quotas for project 150f43b9e49a48ee9b72066f07fe95c4. Resources: {'instances', 'cores', 'ram'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 12:44:26.023368 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-e28b03c3-94c2-4c9f-bb43-72c9f7e961b5 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Getting quotas for user 7cab259dbcb84995aadd366f599afa06 and project 150f43b9e49a48ee9b72066f07fe95c4. Resources: {'instances', 'cores', 'ram'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 12:44:26.080070 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e28b03c3-94c2-4c9f-bb43-72c9f7e961b5 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Going to run 1 instances... {{(pid=117606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 12:44:26.082167 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e28b03c3-94c2-4c9f-bb43-72c9f7e961b5 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: baf074ed-c9fa-4ac4-af2a-eed92f682a8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2817876f-12c6-495b-b173-161d94b56482',volume_size=None,volume_type=None)] {{(pid=117606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 12:44:26.213613 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e28b03c3-94c2-4c9f-bb43-72c9f7e961b5 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.796991 Jun 16 12:44:26.213613 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 585/1178] 10.222.0.45 () {60 vars in 1146 bytes} [Thu Jun 16 12:44:25 2022] POST /compute/v2.1/servers => generated 405 bytes in 798 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 12:44:26.221885 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8257ba96-beac-4e58-9171-0bece5c63bf1] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 16 12:44:26.222604 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=3 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:44:26.223436 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=7 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:44:26.228755 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-90b3a372-527d-4177-aa95-267e30f7c411 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:44:26.229457 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-90b3a372-527d-4177-aa95-267e30f7c411 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: baf074ed-c9fa-4ac4-af2a-eed92f682a8f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:44:26.398975 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-90b3a372-527d-4177-aa95-267e30f7c411 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab259dbcb84995aadd366f599afa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150f43b9e49a48ee9b72066f07fe95c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:44:26.405882 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-90b3a372-527d-4177-aa95-267e30f7c411 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "GET /compute/v2.1/servers/baf074ed-c9fa-4ac4-af2a-eed92f682a8f" status: 200 len: 1092 microversion: 2.1 time: 0.186790 Jun 16 12:44:26.406449 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 594/1179] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:44:26 2022] GET /compute/v2.1/servers/baf074ed-c9fa-4ac4-af2a-eed92f682a8f => generated 1092 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:44:27.424428 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5625fbb7-1255-45a6-bd87-89452de73fbc tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:44:27.425735 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5625fbb7-1255-45a6-bd87-89452de73fbc tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: baf074ed-c9fa-4ac4-af2a-eed92f682a8f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:44:27.436780 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [-] [1d291c8a-58bf-4bfa-ba68-bf67536e2e47] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 47476. Jun 16 12:44:27.480200 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5625fbb7-1255-45a6-bd87-89452de73fbc tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab259dbcb84995aadd366f599afa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150f43b9e49a48ee9b72066f07fe95c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:44:27.487607 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5625fbb7-1255-45a6-bd87-89452de73fbc tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "GET /compute/v2.1/servers/baf074ed-c9fa-4ac4-af2a-eed92f682a8f" status: 200 len: 1092 microversion: 2.1 time: 0.067723 Jun 16 12:44:27.488230 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 586/1180] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:44:27 2022] GET /compute/v2.1/servers/baf074ed-c9fa-4ac4-af2a-eed92f682a8f => generated 1092 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:44:28.505057 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-76dc76ed-1c20-4200-819f-f2b78880cc20 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:44:28.505675 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-76dc76ed-1c20-4200-819f-f2b78880cc20 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: baf074ed-c9fa-4ac4-af2a-eed92f682a8f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:44:28.518496 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO oslo.messaging._drivers.impl_rabbit [-] [8257ba96-beac-4e58-9171-0bece5c63bf1] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 47486. Jun 16 12:44:28.564404 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-76dc76ed-1c20-4200-819f-f2b78880cc20 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab259dbcb84995aadd366f599afa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150f43b9e49a48ee9b72066f07fe95c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:44:28.571690 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-76dc76ed-1c20-4200-819f-f2b78880cc20 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "GET /compute/v2.1/servers/baf074ed-c9fa-4ac4-af2a-eed92f682a8f" status: 200 len: 1092 microversion: 2.1 time: 0.071170 Jun 16 12:44:28.572251 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 595/1181] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:44:28 2022] GET /compute/v2.1/servers/baf074ed-c9fa-4ac4-af2a-eed92f682a8f => generated 1092 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:44:29.588220 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1aea3b7e-bb92-4f88-87e3-d3de13e8c715 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:44:29.588837 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1aea3b7e-bb92-4f88-87e3-d3de13e8c715 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: baf074ed-c9fa-4ac4-af2a-eed92f682a8f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:44:29.643784 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1aea3b7e-bb92-4f88-87e3-d3de13e8c715 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab259dbcb84995aadd366f599afa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150f43b9e49a48ee9b72066f07fe95c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:44:29.650771 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1aea3b7e-bb92-4f88-87e3-d3de13e8c715 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "GET /compute/v2.1/servers/baf074ed-c9fa-4ac4-af2a-eed92f682a8f" status: 200 len: 1092 microversion: 2.1 time: 0.066365 Jun 16 12:44:29.651598 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 587/1182] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:44:29 2022] GET /compute/v2.1/servers/baf074ed-c9fa-4ac4-af2a-eed92f682a8f => generated 1092 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:44:30.668112 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8627e15b-98a0-49ae-a16e-bc0195349020 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:44:30.668721 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8627e15b-98a0-49ae-a16e-bc0195349020 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: baf074ed-c9fa-4ac4-af2a-eed92f682a8f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:44:30.675934 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8627e15b-98a0-49ae-a16e-bc0195349020 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:44:30.676642 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8627e15b-98a0-49ae-a16e-bc0195349020 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:44:30.677138 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8627e15b-98a0-49ae-a16e-bc0195349020 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:44:30.677572 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8627e15b-98a0-49ae-a16e-bc0195349020 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:44:30.744371 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8627e15b-98a0-49ae-a16e-bc0195349020 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab259dbcb84995aadd366f599afa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150f43b9e49a48ee9b72066f07fe95c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:44:30.751885 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8627e15b-98a0-49ae-a16e-bc0195349020 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "GET /compute/v2.1/servers/baf074ed-c9fa-4ac4-af2a-eed92f682a8f" status: 200 len: 1142 microversion: 2.1 time: 0.087605 Jun 16 12:44:30.752461 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 596/1183] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:44:30 2022] GET /compute/v2.1/servers/baf074ed-c9fa-4ac4-af2a-eed92f682a8f => generated 1142 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:44:31.768663 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-570178c7-a7ba-4f69-b520-9dddc9c7ff79 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:44:31.770194 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-570178c7-a7ba-4f69-b520-9dddc9c7ff79 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: baf074ed-c9fa-4ac4-af2a-eed92f682a8f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:44:31.777743 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-570178c7-a7ba-4f69-b520-9dddc9c7ff79 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:44:31.778222 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-570178c7-a7ba-4f69-b520-9dddc9c7ff79 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:44:31.779047 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-570178c7-a7ba-4f69-b520-9dddc9c7ff79 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:44:31.779488 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-570178c7-a7ba-4f69-b520-9dddc9c7ff79 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:44:31.858865 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-570178c7-a7ba-4f69-b520-9dddc9c7ff79 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab259dbcb84995aadd366f599afa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150f43b9e49a48ee9b72066f07fe95c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:44:31.866956 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-570178c7-a7ba-4f69-b520-9dddc9c7ff79 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "GET /compute/v2.1/servers/baf074ed-c9fa-4ac4-af2a-eed92f682a8f" status: 200 len: 1208 microversion: 2.1 time: 0.102119 Jun 16 12:44:31.867790 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 588/1184] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:44:31 2022] GET /compute/v2.1/servers/baf074ed-c9fa-4ac4-af2a-eed92f682a8f => generated 1208 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:44:32.873231 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-69c88a0b-1233-4a2c-bedd-e4bb12bec2da req-a1c214e2-96de-4b90-add2-05d3d5da6fa7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "baf074ed-c9fa-4ac4-af2a-eed92f682a8f", "tag": "b58965d8-0cfa-48aa-82e9-5531c58f946d"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:44:32.883766 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8522deea-97ae-4533-a758-6055c7c94c52 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:44:32.884388 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8522deea-97ae-4533-a758-6055c7c94c52 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: baf074ed-c9fa-4ac4-af2a-eed92f682a8f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:44:32.884817 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-69c88a0b-1233-4a2c-bedd-e4bb12bec2da req-a1c214e2-96de-4b90-add2-05d3d5da6fa7 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:44:32.885464 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-69c88a0b-1233-4a2c-bedd-e4bb12bec2da req-a1c214e2-96de-4b90-add2-05d3d5da6fa7 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:44:32.892414 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8522deea-97ae-4533-a758-6055c7c94c52 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:44:32.892876 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8522deea-97ae-4533-a758-6055c7c94c52 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:44:32.893681 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8522deea-97ae-4533-a758-6055c7c94c52 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:44:32.894190 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8522deea-97ae-4533-a758-6055c7c94c52 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:44:32.897834 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-69c88a0b-1233-4a2c-bedd-e4bb12bec2da req-a1c214e2-96de-4b90-add2-05d3d5da6fa7 service nova] Creating event network-changed:b58965d8-0cfa-48aa-82e9-5531c58f946d for instance baf074ed-c9fa-4ac4-af2a-eed92f682a8f on hv-cinder-84614 Jun 16 12:44:32.903821 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-69c88a0b-1233-4a2c-bedd-e4bb12bec2da req-a1c214e2-96de-4b90-add2-05d3d5da6fa7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112821 Jun 16 12:44:32.905344 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 597/1185] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:44:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:44:33.111825 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8522deea-97ae-4533-a758-6055c7c94c52 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab259dbcb84995aadd366f599afa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150f43b9e49a48ee9b72066f07fe95c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:44:33.119870 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8522deea-97ae-4533-a758-6055c7c94c52 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "GET /compute/v2.1/servers/baf074ed-c9fa-4ac4-af2a-eed92f682a8f" status: 200 len: 1263 microversion: 2.1 time: 0.239854 Jun 16 12:44:33.120548 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 589/1186] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:44:32 2022] GET /compute/v2.1/servers/baf074ed-c9fa-4ac4-af2a-eed92f682a8f => generated 1263 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 12:44:34.138208 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0179d14d-002b-49a9-8eee-d2e32593821e tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:44:34.138930 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0179d14d-002b-49a9-8eee-d2e32593821e tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: baf074ed-c9fa-4ac4-af2a-eed92f682a8f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:44:34.146916 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0179d14d-002b-49a9-8eee-d2e32593821e tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:44:34.147367 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0179d14d-002b-49a9-8eee-d2e32593821e tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:44:34.148198 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0179d14d-002b-49a9-8eee-d2e32593821e tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:44:34.148637 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0179d14d-002b-49a9-8eee-d2e32593821e tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:44:34.345444 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0179d14d-002b-49a9-8eee-d2e32593821e tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab259dbcb84995aadd366f599afa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150f43b9e49a48ee9b72066f07fe95c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:44:34.353361 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0179d14d-002b-49a9-8eee-d2e32593821e tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "GET /compute/v2.1/servers/baf074ed-c9fa-4ac4-af2a-eed92f682a8f" status: 200 len: 1263 microversion: 2.1 time: 0.219348 Jun 16 12:44:34.354277 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 598/1187] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:44:34 2022] GET /compute/v2.1/servers/baf074ed-c9fa-4ac4-af2a-eed92f682a8f => generated 1263 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:44:35.369998 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a919bf35-444b-4b54-b9d9-f9dfef68954d tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:44:35.370611 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a919bf35-444b-4b54-b9d9-f9dfef68954d tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: baf074ed-c9fa-4ac4-af2a-eed92f682a8f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:44:35.377043 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a919bf35-444b-4b54-b9d9-f9dfef68954d tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:44:35.377488 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a919bf35-444b-4b54-b9d9-f9dfef68954d tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:44:35.378900 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a919bf35-444b-4b54-b9d9-f9dfef68954d tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:44:35.379399 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a919bf35-444b-4b54-b9d9-f9dfef68954d tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:44:35.508436 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a919bf35-444b-4b54-b9d9-f9dfef68954d tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab259dbcb84995aadd366f599afa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150f43b9e49a48ee9b72066f07fe95c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:44:35.516151 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a919bf35-444b-4b54-b9d9-f9dfef68954d tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "GET /compute/v2.1/servers/baf074ed-c9fa-4ac4-af2a-eed92f682a8f" status: 200 len: 1263 microversion: 2.1 time: 0.150120 Jun 16 12:44:35.516719 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 590/1188] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:44:35 2022] GET /compute/v2.1/servers/baf074ed-c9fa-4ac4-af2a-eed92f682a8f => generated 1263 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:44:36.532590 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7f4cec31-d5ac-48f2-90e3-701de9d7db09 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:44:36.533211 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7f4cec31-d5ac-48f2-90e3-701de9d7db09 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: baf074ed-c9fa-4ac4-af2a-eed92f682a8f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:44:36.540527 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7f4cec31-d5ac-48f2-90e3-701de9d7db09 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:44:36.540975 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7f4cec31-d5ac-48f2-90e3-701de9d7db09 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:44:36.541740 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7f4cec31-d5ac-48f2-90e3-701de9d7db09 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:44:36.542212 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7f4cec31-d5ac-48f2-90e3-701de9d7db09 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:44:36.681055 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7f4cec31-d5ac-48f2-90e3-701de9d7db09 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab259dbcb84995aadd366f599afa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150f43b9e49a48ee9b72066f07fe95c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:44:36.688425 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7f4cec31-d5ac-48f2-90e3-701de9d7db09 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "GET /compute/v2.1/servers/baf074ed-c9fa-4ac4-af2a-eed92f682a8f" status: 200 len: 1263 microversion: 2.1 time: 0.159715 Jun 16 12:44:36.688978 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 599/1189] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:44:36 2022] GET /compute/v2.1/servers/baf074ed-c9fa-4ac4-af2a-eed92f682a8f => generated 1263 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:44:37.704846 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-65828e0d-cc58-4142-b85b-138a2a3c532a tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:44:37.705452 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-65828e0d-cc58-4142-b85b-138a2a3c532a tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: baf074ed-c9fa-4ac4-af2a-eed92f682a8f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:44:37.707882 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=2 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:44:37.713441 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-65828e0d-cc58-4142-b85b-138a2a3c532a tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:44:37.713904 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-65828e0d-cc58-4142-b85b-138a2a3c532a tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:44:37.714666 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-65828e0d-cc58-4142-b85b-138a2a3c532a tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:44:37.715096 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-65828e0d-cc58-4142-b85b-138a2a3c532a tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:44:37.844480 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-65828e0d-cc58-4142-b85b-138a2a3c532a tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab259dbcb84995aadd366f599afa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150f43b9e49a48ee9b72066f07fe95c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:44:37.851893 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-65828e0d-cc58-4142-b85b-138a2a3c532a tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "GET /compute/v2.1/servers/baf074ed-c9fa-4ac4-af2a-eed92f682a8f" status: 200 len: 1263 microversion: 2.1 time: 0.150881 Jun 16 12:44:37.852453 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 591/1190] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:44:37 2022] GET /compute/v2.1/servers/baf074ed-c9fa-4ac4-af2a-eed92f682a8f => generated 1263 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:44:38.868362 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c3529c8f-f52f-45bd-98b5-5223ca97abae tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:44:38.868963 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c3529c8f-f52f-45bd-98b5-5223ca97abae tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: baf074ed-c9fa-4ac4-af2a-eed92f682a8f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:44:38.871371 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell0:SELECT=4 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:44:38.876986 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c3529c8f-f52f-45bd-98b5-5223ca97abae tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:44:38.877444 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c3529c8f-f52f-45bd-98b5-5223ca97abae tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:44:38.878738 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c3529c8f-f52f-45bd-98b5-5223ca97abae tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:44:38.879182 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c3529c8f-f52f-45bd-98b5-5223ca97abae tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:44:39.017294 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c3529c8f-f52f-45bd-98b5-5223ca97abae tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab259dbcb84995aadd366f599afa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150f43b9e49a48ee9b72066f07fe95c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:44:39.025392 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c3529c8f-f52f-45bd-98b5-5223ca97abae tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "GET /compute/v2.1/servers/baf074ed-c9fa-4ac4-af2a-eed92f682a8f" status: 200 len: 1263 microversion: 2.1 time: 0.160867 Jun 16 12:44:39.025981 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 600/1191] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:44:38 2022] GET /compute/v2.1/servers/baf074ed-c9fa-4ac4-af2a-eed92f682a8f => generated 1263 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:44:40.042298 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-65c02959-9e33-4be6-9fe0-ebf5c574799d tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:44:40.042918 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-65c02959-9e33-4be6-9fe0-ebf5c574799d tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: baf074ed-c9fa-4ac4-af2a-eed92f682a8f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:44:40.045214 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=10 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:44:40.051387 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-65c02959-9e33-4be6-9fe0-ebf5c574799d tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:44:40.051847 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-65c02959-9e33-4be6-9fe0-ebf5c574799d tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:44:40.052643 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-65c02959-9e33-4be6-9fe0-ebf5c574799d tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:44:40.053081 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-65c02959-9e33-4be6-9fe0-ebf5c574799d tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:44:40.182145 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-65c02959-9e33-4be6-9fe0-ebf5c574799d tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab259dbcb84995aadd366f599afa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150f43b9e49a48ee9b72066f07fe95c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:44:40.189594 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-65c02959-9e33-4be6-9fe0-ebf5c574799d tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "GET /compute/v2.1/servers/baf074ed-c9fa-4ac4-af2a-eed92f682a8f" status: 200 len: 1263 microversion: 2.1 time: 0.151203 Jun 16 12:44:40.190186 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 592/1192] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:44:40 2022] GET /compute/v2.1/servers/baf074ed-c9fa-4ac4-af2a-eed92f682a8f => generated 1263 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:44:41.206676 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-74d6b1c3-c345-4b92-845e-ff95f3cb1e67 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:44:41.207316 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-74d6b1c3-c345-4b92-845e-ff95f3cb1e67 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: baf074ed-c9fa-4ac4-af2a-eed92f682a8f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:44:41.213923 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-74d6b1c3-c345-4b92-845e-ff95f3cb1e67 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:44:41.214392 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-74d6b1c3-c345-4b92-845e-ff95f3cb1e67 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:44:41.215203 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-74d6b1c3-c345-4b92-845e-ff95f3cb1e67 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:44:41.216039 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-74d6b1c3-c345-4b92-845e-ff95f3cb1e67 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:44:41.346839 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-74d6b1c3-c345-4b92-845e-ff95f3cb1e67 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab259dbcb84995aadd366f599afa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150f43b9e49a48ee9b72066f07fe95c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:44:41.354450 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-74d6b1c3-c345-4b92-845e-ff95f3cb1e67 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "GET /compute/v2.1/servers/baf074ed-c9fa-4ac4-af2a-eed92f682a8f" status: 200 len: 1263 microversion: 2.1 time: 0.151638 Jun 16 12:44:41.355029 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 601/1193] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:44:41 2022] GET /compute/v2.1/servers/baf074ed-c9fa-4ac4-af2a-eed92f682a8f => generated 1263 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:44:42.371029 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9bc9a2da-d43b-4a7d-b3ec-5993bc07bc15 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:44:42.371722 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9bc9a2da-d43b-4a7d-b3ec-5993bc07bc15 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: baf074ed-c9fa-4ac4-af2a-eed92f682a8f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:44:42.378494 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9bc9a2da-d43b-4a7d-b3ec-5993bc07bc15 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:44:42.378942 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9bc9a2da-d43b-4a7d-b3ec-5993bc07bc15 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:44:42.379700 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9bc9a2da-d43b-4a7d-b3ec-5993bc07bc15 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:44:42.380252 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9bc9a2da-d43b-4a7d-b3ec-5993bc07bc15 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:44:42.512234 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9bc9a2da-d43b-4a7d-b3ec-5993bc07bc15 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab259dbcb84995aadd366f599afa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150f43b9e49a48ee9b72066f07fe95c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:44:42.519693 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9bc9a2da-d43b-4a7d-b3ec-5993bc07bc15 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "GET /compute/v2.1/servers/baf074ed-c9fa-4ac4-af2a-eed92f682a8f" status: 200 len: 1263 microversion: 2.1 time: 0.152471 Jun 16 12:44:42.520833 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 593/1194] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:44:42 2022] GET /compute/v2.1/servers/baf074ed-c9fa-4ac4-af2a-eed92f682a8f => generated 1263 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:44:43.538616 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-49c6493c-3982-47d4-b342-3983280ea7a5 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:44:43.539227 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-49c6493c-3982-47d4-b342-3983280ea7a5 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: baf074ed-c9fa-4ac4-af2a-eed92f682a8f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:44:43.545629 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-49c6493c-3982-47d4-b342-3983280ea7a5 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:44:43.546112 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-49c6493c-3982-47d4-b342-3983280ea7a5 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:44:43.546870 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-49c6493c-3982-47d4-b342-3983280ea7a5 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:44:43.547302 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-49c6493c-3982-47d4-b342-3983280ea7a5 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:44:43.674468 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-49c6493c-3982-47d4-b342-3983280ea7a5 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab259dbcb84995aadd366f599afa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150f43b9e49a48ee9b72066f07fe95c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:44:43.682061 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-49c6493c-3982-47d4-b342-3983280ea7a5 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "GET /compute/v2.1/servers/baf074ed-c9fa-4ac4-af2a-eed92f682a8f" status: 200 len: 1263 microversion: 2.1 time: 0.148355 Jun 16 12:44:43.682623 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 602/1195] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:44:43 2022] GET /compute/v2.1/servers/baf074ed-c9fa-4ac4-af2a-eed92f682a8f => generated 1263 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:44:44.597472 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-a63a9d41-3931-44cf-992a-322d167c03c2 req-885b5b3d-9a62-4704-bc7a-c43e79e9377a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baf074ed-c9fa-4ac4-af2a-eed92f682a8f", "name": "network-vif-plugged", "status": "completed", "tag": "b58965d8-0cfa-48aa-82e9-5531c58f946d"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:44:44.605738 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-a63a9d41-3931-44cf-992a-322d167c03c2 req-885b5b3d-9a62-4704-bc7a-c43e79e9377a service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:44:44.606166 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-a63a9d41-3931-44cf-992a-322d167c03c2 req-885b5b3d-9a62-4704-bc7a-c43e79e9377a service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:44:44.617711 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-a63a9d41-3931-44cf-992a-322d167c03c2 req-885b5b3d-9a62-4704-bc7a-c43e79e9377a service nova] Creating event network-vif-plugged:b58965d8-0cfa-48aa-82e9-5531c58f946d for instance baf074ed-c9fa-4ac4-af2a-eed92f682a8f on hv-cinder-84614 Jun 16 12:44:44.623137 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-a63a9d41-3931-44cf-992a-322d167c03c2 req-885b5b3d-9a62-4704-bc7a-c43e79e9377a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092885 Jun 16 12:44:44.623716 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 594/1196] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:44:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:44:44.698935 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b92d6148-ec03-428f-b599-51663ee367db tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:44:44.699543 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b92d6148-ec03-428f-b599-51663ee367db tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: baf074ed-c9fa-4ac4-af2a-eed92f682a8f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:44:44.705960 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b92d6148-ec03-428f-b599-51663ee367db tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:44:44.706409 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b92d6148-ec03-428f-b599-51663ee367db tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:44:44.707185 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b92d6148-ec03-428f-b599-51663ee367db tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:44:44.707591 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b92d6148-ec03-428f-b599-51663ee367db tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:44:44.876393 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b92d6148-ec03-428f-b599-51663ee367db tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab259dbcb84995aadd366f599afa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150f43b9e49a48ee9b72066f07fe95c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:44:44.884260 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b92d6148-ec03-428f-b599-51663ee367db tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "GET /compute/v2.1/servers/baf074ed-c9fa-4ac4-af2a-eed92f682a8f" status: 200 len: 1263 microversion: 2.1 time: 0.189178 Jun 16 12:44:44.884837 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 603/1197] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:44:44 2022] GET /compute/v2.1/servers/baf074ed-c9fa-4ac4-af2a-eed92f682a8f => generated 1263 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:44:45.902301 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-37b38305-24ea-4188-a6a0-715531059d13 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:44:45.902996 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-37b38305-24ea-4188-a6a0-715531059d13 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: baf074ed-c9fa-4ac4-af2a-eed92f682a8f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:44:45.909155 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-37b38305-24ea-4188-a6a0-715531059d13 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:44:45.909622 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-37b38305-24ea-4188-a6a0-715531059d13 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:44:45.911126 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-37b38305-24ea-4188-a6a0-715531059d13 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:44:45.911591 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-37b38305-24ea-4188-a6a0-715531059d13 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:44:46.042933 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-37b38305-24ea-4188-a6a0-715531059d13 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab259dbcb84995aadd366f599afa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150f43b9e49a48ee9b72066f07fe95c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:44:46.050275 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-37b38305-24ea-4188-a6a0-715531059d13 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "GET /compute/v2.1/servers/baf074ed-c9fa-4ac4-af2a-eed92f682a8f" status: 200 len: 1263 microversion: 2.1 time: 0.152867 Jun 16 12:44:46.050829 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 595/1198] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:44:45 2022] GET /compute/v2.1/servers/baf074ed-c9fa-4ac4-af2a-eed92f682a8f => generated 1263 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:44:47.067638 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-fc991ac8-64c6-468e-be92-78bfecf518c5 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:44:47.068245 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-fc991ac8-64c6-468e-be92-78bfecf518c5 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: baf074ed-c9fa-4ac4-af2a-eed92f682a8f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:44:47.074931 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fc991ac8-64c6-468e-be92-78bfecf518c5 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:44:47.075358 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fc991ac8-64c6-468e-be92-78bfecf518c5 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:44:47.076106 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fc991ac8-64c6-468e-be92-78bfecf518c5 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:44:47.076535 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fc991ac8-64c6-468e-be92-78bfecf518c5 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:44:47.212516 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-fc991ac8-64c6-468e-be92-78bfecf518c5 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab259dbcb84995aadd366f599afa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150f43b9e49a48ee9b72066f07fe95c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:44:47.219951 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-fc991ac8-64c6-468e-be92-78bfecf518c5 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "GET /compute/v2.1/servers/baf074ed-c9fa-4ac4-af2a-eed92f682a8f" status: 200 len: 1451 microversion: 2.1 time: 0.156367 Jun 16 12:44:47.220520 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 604/1199] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:44:47 2022] GET /compute/v2.1/servers/baf074ed-c9fa-4ac4-af2a-eed92f682a8f => generated 1451 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:44:47.236711 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-817d2411-9794-4fae-8791-032462aaa550 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:44:47.237327 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-817d2411-9794-4fae-8791-032462aaa550 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: baf074ed-c9fa-4ac4-af2a-eed92f682a8f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:44:47.244689 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-817d2411-9794-4fae-8791-032462aaa550 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:44:47.245166 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-817d2411-9794-4fae-8791-032462aaa550 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:44:47.245951 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-817d2411-9794-4fae-8791-032462aaa550 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:44:47.246391 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-817d2411-9794-4fae-8791-032462aaa550 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:44:47.375102 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-817d2411-9794-4fae-8791-032462aaa550 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab259dbcb84995aadd366f599afa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150f43b9e49a48ee9b72066f07fe95c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:44:47.382639 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-817d2411-9794-4fae-8791-032462aaa550 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "GET /compute/v2.1/servers/baf074ed-c9fa-4ac4-af2a-eed92f682a8f" status: 200 len: 1451 microversion: 2.1 time: 0.149663 Jun 16 12:44:47.383205 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 596/1200] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:44:47 2022] GET /compute/v2.1/servers/baf074ed-c9fa-4ac4-af2a-eed92f682a8f => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:44:49.298155 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-77b3508b-1730-4560-9f8e-d31e5c56228f req-b1b25553-f1f4-4edb-8b48-495e9d53675d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "baf074ed-c9fa-4ac4-af2a-eed92f682a8f", "tag": "b58965d8-0cfa-48aa-82e9-5531c58f946d"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:44:49.306837 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-77b3508b-1730-4560-9f8e-d31e5c56228f req-b1b25553-f1f4-4edb-8b48-495e9d53675d service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:44:49.307287 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-77b3508b-1730-4560-9f8e-d31e5c56228f req-b1b25553-f1f4-4edb-8b48-495e9d53675d service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:44:49.318902 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-77b3508b-1730-4560-9f8e-d31e5c56228f req-b1b25553-f1f4-4edb-8b48-495e9d53675d service nova] Creating event network-changed:b58965d8-0cfa-48aa-82e9-5531c58f946d for instance baf074ed-c9fa-4ac4-af2a-eed92f682a8f on hv-cinder-84614 Jun 16 12:44:49.324255 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-77b3508b-1730-4560-9f8e-d31e5c56228f req-b1b25553-f1f4-4edb-8b48-495e9d53675d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029897 Jun 16 12:44:49.324932 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 605/1201] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:44:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:45:06.868644 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 12:45:06.869374 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Thu Jun 16 12:45:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 12:45:32.144328 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 12:45:32.145162 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Thu Jun 16 12:45:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 12:46:42.805821 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:46:42.806699 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=52 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:46:42.808573 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8257ba96-beac-4e58-9171-0bece5c63bf1] AMQP server on 10.222.0.45:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jun 16 12:46:42.809200 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=28 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:46:42.810018 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=52 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:46:42.811834 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-bda6e7f9-3d91-4fd0-a414-dc846f101c4f tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:46:42.812401 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-bda6e7f9-3d91-4fd0-a414-dc846f101c4f tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: baf074ed-c9fa-4ac4-af2a-eed92f682a8f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:46:42.815119 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-11bb80ca-b4d2-4667-b82f-9a0203a0174b req-1658f577-8c54-40c3-a780-d0da2da1bab4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "baf074ed-c9fa-4ac4-af2a-eed92f682a8f", "tag": "b58965d8-0cfa-48aa-82e9-5531c58f946d"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:46:42.822801 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bda6e7f9-3d91-4fd0-a414-dc846f101c4f tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:46:42.823720 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bda6e7f9-3d91-4fd0-a414-dc846f101c4f tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:46:42.824107 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bda6e7f9-3d91-4fd0-a414-dc846f101c4f tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:46:42.824584 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bda6e7f9-3d91-4fd0-a414-dc846f101c4f tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:46:42.830197 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-11bb80ca-b4d2-4667-b82f-9a0203a0174b req-1658f577-8c54-40c3-a780-d0da2da1bab4 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:46:42.830197 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-11bb80ca-b4d2-4667-b82f-9a0203a0174b req-1658f577-8c54-40c3-a780-d0da2da1bab4 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:46:42.841389 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-11bb80ca-b4d2-4667-b82f-9a0203a0174b req-1658f577-8c54-40c3-a780-d0da2da1bab4 service nova] Creating event network-changed:b58965d8-0cfa-48aa-82e9-5531c58f946d for instance baf074ed-c9fa-4ac4-af2a-eed92f682a8f on hv-cinder-84614 Jun 16 12:46:42.848038 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-11bb80ca-b4d2-4667-b82f-9a0203a0174b req-1658f577-8c54-40c3-a780-d0da2da1bab4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041193 Jun 16 12:46:42.848851 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 606/1202] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:46:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 12:46:42.853376 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-bda6e7f9-3d91-4fd0-a414-dc846f101c4f tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: baf074ed-c9fa-4ac4-af2a-eed92f682a8f] Going to try to terminate instance {{(pid=117606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 12:46:42.941620 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-bda6e7f9-3d91-4fd0-a414-dc846f101c4f tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "DELETE /compute/v2.1/servers/baf074ed-c9fa-4ac4-af2a-eed92f682a8f" status: 204 len: 0 microversion: 2.1 time: 0.137575 Jun 16 12:46:42.946416 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 597/1203] 10.222.0.45 () {58 vars in 1238 bytes} [Thu Jun 16 12:46:42 2022] DELETE /compute/v2.1/servers/baf074ed-c9fa-4ac4-af2a-eed92f682a8f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 12:46:42.955307 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c27498f7-fc35-4f05-83be-cbb55bf1868a tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:46:42.956284 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c27498f7-fc35-4f05-83be-cbb55bf1868a tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: baf074ed-c9fa-4ac4-af2a-eed92f682a8f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:46:42.962796 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c27498f7-fc35-4f05-83be-cbb55bf1868a tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:46:42.963575 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c27498f7-fc35-4f05-83be-cbb55bf1868a tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:46:42.964567 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c27498f7-fc35-4f05-83be-cbb55bf1868a tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:46:42.965072 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c27498f7-fc35-4f05-83be-cbb55bf1868a tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:46:43.128560 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c27498f7-fc35-4f05-83be-cbb55bf1868a tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab259dbcb84995aadd366f599afa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150f43b9e49a48ee9b72066f07fe95c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:46:43.136049 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c27498f7-fc35-4f05-83be-cbb55bf1868a tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "GET /compute/v2.1/servers/baf074ed-c9fa-4ac4-af2a-eed92f682a8f" status: 200 len: 1575 microversion: 2.1 time: 0.185309 Jun 16 12:46:43.136615 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 607/1204] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:46:42 2022] GET /compute/v2.1/servers/baf074ed-c9fa-4ac4-af2a-eed92f682a8f => generated 1575 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:46:44.155427 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5419b01c-b300-4f91-8022-fd098bf08f24 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:46:44.156137 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5419b01c-b300-4f91-8022-fd098bf08f24 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: baf074ed-c9fa-4ac4-af2a-eed92f682a8f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:46:44.164073 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5419b01c-b300-4f91-8022-fd098bf08f24 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:46:44.164518 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5419b01c-b300-4f91-8022-fd098bf08f24 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:46:44.165277 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5419b01c-b300-4f91-8022-fd098bf08f24 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:46:44.165717 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5419b01c-b300-4f91-8022-fd098bf08f24 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:46:44.314030 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5419b01c-b300-4f91-8022-fd098bf08f24 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab259dbcb84995aadd366f599afa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150f43b9e49a48ee9b72066f07fe95c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:46:44.321489 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5419b01c-b300-4f91-8022-fd098bf08f24 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "GET /compute/v2.1/servers/baf074ed-c9fa-4ac4-af2a-eed92f682a8f" status: 200 len: 1575 microversion: 2.1 time: 0.170538 Jun 16 12:46:44.322092 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 598/1205] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:46:44 2022] GET /compute/v2.1/servers/baf074ed-c9fa-4ac4-af2a-eed92f682a8f => generated 1575 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:46:45.117503 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-5b6f8c3d-f189-4c27-a77f-f23c6de5107c req-3bf8e6e8-98c5-472e-884b-e2c66ab4cf00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baf074ed-c9fa-4ac4-af2a-eed92f682a8f", "name": "network-vif-deleted", "tag": "b58965d8-0cfa-48aa-82e9-5531c58f946d"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:46:45.131290 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO oslo.messaging._drivers.impl_rabbit [-] [8257ba96-beac-4e58-9171-0bece5c63bf1] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 47602. Jun 16 12:46:45.135834 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-5b6f8c3d-f189-4c27-a77f-f23c6de5107c req-3bf8e6e8-98c5-472e-884b-e2c66ab4cf00 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:46:45.136279 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-5b6f8c3d-f189-4c27-a77f-f23c6de5107c req-3bf8e6e8-98c5-472e-884b-e2c66ab4cf00 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:46:45.148989 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-5b6f8c3d-f189-4c27-a77f-f23c6de5107c req-3bf8e6e8-98c5-472e-884b-e2c66ab4cf00 service nova] Creating event network-vif-deleted:b58965d8-0cfa-48aa-82e9-5531c58f946d for instance baf074ed-c9fa-4ac4-af2a-eed92f682a8f on hv-cinder-84614 Jun 16 12:46:45.154213 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-5b6f8c3d-f189-4c27-a77f-f23c6de5107c req-3bf8e6e8-98c5-472e-884b-e2c66ab4cf00 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040145 Jun 16 12:46:45.154956 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 608/1206] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:46:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:46:45.338585 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-76ec8c51-24d8-4fd2-aa86-ff2b791681e3 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:46:45.339132 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-76ec8c51-24d8-4fd2-aa86-ff2b791681e3 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: baf074ed-c9fa-4ac4-af2a-eed92f682a8f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:46:45.346220 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-76ec8c51-24d8-4fd2-aa86-ff2b791681e3 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:46:45.346667 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-76ec8c51-24d8-4fd2-aa86-ff2b791681e3 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:46:45.347421 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-76ec8c51-24d8-4fd2-aa86-ff2b791681e3 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:46:45.347852 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-76ec8c51-24d8-4fd2-aa86-ff2b791681e3 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:46:45.414201 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-76ec8c51-24d8-4fd2-aa86-ff2b791681e3 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab259dbcb84995aadd366f599afa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150f43b9e49a48ee9b72066f07fe95c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:46:45.422756 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-76ec8c51-24d8-4fd2-aa86-ff2b791681e3 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "GET /compute/v2.1/servers/baf074ed-c9fa-4ac4-af2a-eed92f682a8f" status: 200 len: 1223 microversion: 2.1 time: 0.087258 Jun 16 12:46:45.423868 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 599/1207] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:46:45 2022] GET /compute/v2.1/servers/baf074ed-c9fa-4ac4-af2a-eed92f682a8f => generated 1223 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:46:45.564622 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 12:46:45.564805 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Thu Jun 16 12:46:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 12:46:46.440810 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d82fbdf0-1f95-4895-b8ac-638dc7a76474 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:46:46.441512 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d82fbdf0-1f95-4895-b8ac-638dc7a76474 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: baf074ed-c9fa-4ac4-af2a-eed92f682a8f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:46:46.448139 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d82fbdf0-1f95-4895-b8ac-638dc7a76474 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:46:46.448590 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d82fbdf0-1f95-4895-b8ac-638dc7a76474 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:46:46.449347 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d82fbdf0-1f95-4895-b8ac-638dc7a76474 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:46:46.449802 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d82fbdf0-1f95-4895-b8ac-638dc7a76474 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:46:46.463183 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-d82fbdf0-1f95-4895-b8ac-638dc7a76474 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] HTTP exception thrown: Instance baf074ed-c9fa-4ac4-af2a-eed92f682a8f could not be found. Jun 16 12:46:46.464768 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d82fbdf0-1f95-4895-b8ac-638dc7a76474 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Request method failure captured: Jun 16 12:46:46.464768 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: request: GET /compute/v2.1/servers/baf074ed-c9fa-4ac4-af2a-eed92f682a8f HTTP/1.1 Jun 16 12:46:46.464768 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Accept: application/json Jun 16 12:46:46.464768 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jun 16 12:46:46.464768 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Connection: close Jun 16 12:46:46.464768 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jun 16 12:46:46.464768 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jun 16 12:46:46.464768 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Host: 10.222.0.45 Jun 16 12:46:46.464768 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jun 16 12:46:46.464768 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jun 16 12:46:46.464768 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABiqyRCVe1nO68hUC5nq5ZPKCn6diHqewjzZl_C0p-GDE0Qhc-3c8ZV5ouJSCgffRyWnI2QsBhNAO7XnfqW1aXeSIvVyZcZugaGGH8Q96UIBSpSxOv54KQsxGK3lSGrnP1wKkKE85DLIY_AKghOggAiE6RcKLStKgScpvdSjpRGC5UwgeY Jun 16 12:46:46.464768 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jun 16 12:46:46.464768 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jun 16 12:46:46.464768 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jun 16 12:46:46.464768 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jun 16 12:46:46.464768 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jun 16 12:46:46.464768 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jun 16 12:46:46.464768 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Id: 150f43b9e49a48ee9b72066f07fe95c4 Jun 16 12:46:46.464768 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-TestVolumeBootPattern-1888988749 Jun 16 12:46:46.464768 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Role: member,reader Jun 16 12:46:46.464768 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Roles: member,reader Jun 16 12:46:46.466595 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/150f43b9e49a48ee9b72066f07fe95c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/150f43b9e49a48ee9b72066f07fe95c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_150f43b9e49a48ee9b72066f07fe95c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/150f43b9e49a48ee9b72066f07fe95c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Jun 16 12:46:46.466595 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-TestVolumeBootPattern-1888988749 Jun 16 12:46:46.466595 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant-Id: 150f43b9e49a48ee9b72066f07fe95c4 Jun 16 12:46:46.466595 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-TestVolumeBootPattern-1888988749 Jun 16 12:46:46.466595 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User: tempest-TestVolumeBootPattern-1888988749-project Jun 16 12:46:46.466595 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jun 16 12:46:46.466595 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jun 16 12:46:46.466595 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Id: 7cab259dbcb84995aadd366f599afa06 Jun 16 12:46:46.466595 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-TestVolumeBootPattern-1888988749-project Jun 16 12:46:46.466595 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: method: > Jun 16 12:46:46.466595 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: exception: Instance baf074ed-c9fa-4ac4-af2a-eed92f682a8f could not be found. Jun 16 12:46:46.466595 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: action_args: {'id': 'baf074ed-c9fa-4ac4-af2a-eed92f682a8f'} Jun 16 12:46:46.467787 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:46:46.467787 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:46:46.467787 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:46:46.467787 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:46:46.467787 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:46:46.467787 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:46:46.467787 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:46:46.467787 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:46:46.467787 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:46:46.467787 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:46:46.467787 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance baf074ed-c9fa-4ac4-af2a-eed92f682a8f could not be found. Jun 16 12:46:46.467787 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:46:46.467787 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:46:46.467787 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:46:46.467787 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:46:46.467787 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:46:46.467787 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:46:46.467787 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:46:46.467787 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:46:46.467787 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:46:46.470263 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:46:46.470263 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 12:46:46.470263 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 12:46:46.470263 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:46:46.470263 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:46:46.470263 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:46:46.470263 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:46:46.470263 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance baf074ed-c9fa-4ac4-af2a-eed92f682a8f could not be found. Jun 16 12:46:46.470263 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:46:46.470263 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:46:46.470263 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:46:46.470263 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:46:46.470263 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:46:46.470263 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:46:46.470263 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:46:46.470263 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:46:46.470263 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance baf074ed-c9fa-4ac4-af2a-eed92f682a8f could not be found. Jun 16 12:46:46.470263 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:46:46.471819 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d82fbdf0-1f95-4895-b8ac-638dc7a76474 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Returning 404 to user: Instance baf074ed-c9fa-4ac4-af2a-eed92f682a8f could not be found. {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:46:46.471819 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d82fbdf0-1f95-4895-b8ac-638dc7a76474 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "GET /compute/v2.1/servers/baf074ed-c9fa-4ac4-af2a-eed92f682a8f" status: 404 len: 111 microversion: 2.1 time: 0.029788 Jun 16 12:46:46.471819 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 609/1208] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:46:46 2022] GET /compute/v2.1/servers/baf074ed-c9fa-4ac4-af2a-eed92f682a8f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 12:46:49.766914 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d7227765-664d-48fa-b0b4-51a5087fec24 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:46:49.767449 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d7227765-664d-48fa-b0b4-51a5087fec24 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: 2870520c-7049-4b01-8f69-f3c71edd419b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:46:49.769127 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-6b5c49f3-75e8-49bf-b257-96cbb014f883 req-818c0b33-f24f-4994-8191-4a5a09b0df32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2870520c-7049-4b01-8f69-f3c71edd419b", "tag": "8644c704-7078-4a92-bece-7470a7104c7f"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:46:49.774468 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d7227765-664d-48fa-b0b4-51a5087fec24 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:46:49.774934 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d7227765-664d-48fa-b0b4-51a5087fec24 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:46:49.776009 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d7227765-664d-48fa-b0b4-51a5087fec24 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:46:49.776586 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d7227765-664d-48fa-b0b4-51a5087fec24 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:46:49.778505 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-6b5c49f3-75e8-49bf-b257-96cbb014f883 req-818c0b33-f24f-4994-8191-4a5a09b0df32 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:46:49.778950 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-6b5c49f3-75e8-49bf-b257-96cbb014f883 req-818c0b33-f24f-4994-8191-4a5a09b0df32 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:46:49.790999 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-6b5c49f3-75e8-49bf-b257-96cbb014f883 req-818c0b33-f24f-4994-8191-4a5a09b0df32 service nova] Creating event network-changed:8644c704-7078-4a92-bece-7470a7104c7f for instance 2870520c-7049-4b01-8f69-f3c71edd419b on hv-cinder-84614 Jun 16 12:46:49.796295 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-6b5c49f3-75e8-49bf-b257-96cbb014f883 req-818c0b33-f24f-4994-8191-4a5a09b0df32 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031943 Jun 16 12:46:49.797717 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 610/1209] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:46:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:46:49.804420 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d7227765-664d-48fa-b0b4-51a5087fec24 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: 2870520c-7049-4b01-8f69-f3c71edd419b] Going to try to terminate instance {{(pid=117606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 12:46:49.891764 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d7227765-664d-48fa-b0b4-51a5087fec24 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "DELETE /compute/v2.1/servers/2870520c-7049-4b01-8f69-f3c71edd419b" status: 204 len: 0 microversion: 2.1 time: 0.128301 Jun 16 12:46:49.892591 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 600/1210] 10.222.0.45 () {58 vars in 1238 bytes} [Thu Jun 16 12:46:49 2022] DELETE /compute/v2.1/servers/2870520c-7049-4b01-8f69-f3c71edd419b => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 12:46:49.901509 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-62b89af3-e89a-46c7-9ce0-1ba257d1ba49 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:46:49.902232 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-62b89af3-e89a-46c7-9ce0-1ba257d1ba49 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: 2870520c-7049-4b01-8f69-f3c71edd419b] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:46:49.909278 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-62b89af3-e89a-46c7-9ce0-1ba257d1ba49 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:46:49.909728 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-62b89af3-e89a-46c7-9ce0-1ba257d1ba49 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:46:49.910514 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-62b89af3-e89a-46c7-9ce0-1ba257d1ba49 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:46:49.910953 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-62b89af3-e89a-46c7-9ce0-1ba257d1ba49 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:46:50.075138 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 12:46:50.075298 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Thu Jun 16 12:46:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 12:46:50.096164 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-62b89af3-e89a-46c7-9ce0-1ba257d1ba49 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab259dbcb84995aadd366f599afa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150f43b9e49a48ee9b72066f07fe95c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:46:50.104417 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-62b89af3-e89a-46c7-9ce0-1ba257d1ba49 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "GET /compute/v2.1/servers/2870520c-7049-4b01-8f69-f3c71edd419b" status: 200 len: 1577 microversion: 2.1 time: 0.207320 Jun 16 12:46:50.104990 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 611/1211] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:46:49 2022] GET /compute/v2.1/servers/2870520c-7049-4b01-8f69-f3c71edd419b => generated 1577 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:46:51.122651 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-61dffda4-2626-4493-919e-d346ec3d86bd tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:46:51.123455 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-61dffda4-2626-4493-919e-d346ec3d86bd tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: 2870520c-7049-4b01-8f69-f3c71edd419b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:46:51.131173 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-61dffda4-2626-4493-919e-d346ec3d86bd tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:46:51.131630 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-61dffda4-2626-4493-919e-d346ec3d86bd tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:46:51.132502 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-61dffda4-2626-4493-919e-d346ec3d86bd tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:46:51.132948 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-61dffda4-2626-4493-919e-d346ec3d86bd tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:46:51.264242 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-61dffda4-2626-4493-919e-d346ec3d86bd tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab259dbcb84995aadd366f599afa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150f43b9e49a48ee9b72066f07fe95c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:46:51.272008 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-61dffda4-2626-4493-919e-d346ec3d86bd tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "GET /compute/v2.1/servers/2870520c-7049-4b01-8f69-f3c71edd419b" status: 200 len: 1577 microversion: 2.1 time: 0.153518 Jun 16 12:46:51.272511 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 601/1212] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:46:51 2022] GET /compute/v2.1/servers/2870520c-7049-4b01-8f69-f3c71edd419b => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:46:52.003034 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-7c8c0446-fcb3-4801-adcb-bedcb7bf493e req-144ca93e-9106-4fd1-b6bc-c661111f5553 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2870520c-7049-4b01-8f69-f3c71edd419b", "name": "network-vif-deleted", "tag": "8644c704-7078-4a92-bece-7470a7104c7f"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 12:46:52.012441 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-7c8c0446-fcb3-4801-adcb-bedcb7bf493e req-144ca93e-9106-4fd1-b6bc-c661111f5553 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:46:52.012880 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-7c8c0446-fcb3-4801-adcb-bedcb7bf493e req-144ca93e-9106-4fd1-b6bc-c661111f5553 service nova] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:46:52.026391 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-7c8c0446-fcb3-4801-adcb-bedcb7bf493e req-144ca93e-9106-4fd1-b6bc-c661111f5553 service nova] Creating event network-vif-deleted:8644c704-7078-4a92-bece-7470a7104c7f for instance 2870520c-7049-4b01-8f69-f3c71edd419b on hv-cinder-84614 Jun 16 12:46:52.031419 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-7c8c0446-fcb3-4801-adcb-bedcb7bf493e req-144ca93e-9106-4fd1-b6bc-c661111f5553 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032694 Jun 16 12:46:52.032575 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 612/1213] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Jun 16 12:46:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 12:46:52.291146 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0b9e13ef-1dfb-44c9-8b6a-3c383f1a6f57 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:46:52.291846 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0b9e13ef-1dfb-44c9-8b6a-3c383f1a6f57 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: 2870520c-7049-4b01-8f69-f3c71edd419b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:46:52.299257 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0b9e13ef-1dfb-44c9-8b6a-3c383f1a6f57 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:46:52.299903 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0b9e13ef-1dfb-44c9-8b6a-3c383f1a6f57 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:46:52.300831 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0b9e13ef-1dfb-44c9-8b6a-3c383f1a6f57 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:46:52.301318 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0b9e13ef-1dfb-44c9-8b6a-3c383f1a6f57 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:46:52.388669 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0b9e13ef-1dfb-44c9-8b6a-3c383f1a6f57 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab259dbcb84995aadd366f599afa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150f43b9e49a48ee9b72066f07fe95c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 12:46:52.397537 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0b9e13ef-1dfb-44c9-8b6a-3c383f1a6f57 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "GET /compute/v2.1/servers/2870520c-7049-4b01-8f69-f3c71edd419b" status: 200 len: 1225 microversion: 2.1 time: 0.111165 Jun 16 12:46:52.406614 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 602/1214] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:46:52 2022] GET /compute/v2.1/servers/2870520c-7049-4b01-8f69-f3c71edd419b => generated 1225 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 12:46:53.415812 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-54f9244f-cc9c-47fc-8c4f-122736a8a7a3 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:46:53.416510 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-54f9244f-cc9c-47fc-8c4f-122736a8a7a3 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: 2870520c-7049-4b01-8f69-f3c71edd419b] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:46:53.422730 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-54f9244f-cc9c-47fc-8c4f-122736a8a7a3 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:46:53.423177 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-54f9244f-cc9c-47fc-8c4f-122736a8a7a3 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:46:53.423927 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-54f9244f-cc9c-47fc-8c4f-122736a8a7a3 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:46:53.424361 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-54f9244f-cc9c-47fc-8c4f-122736a8a7a3 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:46:53.437308 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-54f9244f-cc9c-47fc-8c4f-122736a8a7a3 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] HTTP exception thrown: Instance 2870520c-7049-4b01-8f69-f3c71edd419b could not be found. Jun 16 12:46:53.439550 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-54f9244f-cc9c-47fc-8c4f-122736a8a7a3 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Request method failure captured: Jun 16 12:46:53.439550 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: request: GET /compute/v2.1/servers/2870520c-7049-4b01-8f69-f3c71edd419b HTTP/1.1 Jun 16 12:46:53.439550 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Accept: application/json Jun 16 12:46:53.439550 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jun 16 12:46:53.439550 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Connection: close Jun 16 12:46:53.439550 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jun 16 12:46:53.439550 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jun 16 12:46:53.439550 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Host: 10.222.0.45 Jun 16 12:46:53.439550 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jun 16 12:46:53.439550 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jun 16 12:46:53.439550 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABiqyRCVe1nO68hUC5nq5ZPKCn6diHqewjzZl_C0p-GDE0Qhc-3c8ZV5ouJSCgffRyWnI2QsBhNAO7XnfqW1aXeSIvVyZcZugaGGH8Q96UIBSpSxOv54KQsxGK3lSGrnP1wKkKE85DLIY_AKghOggAiE6RcKLStKgScpvdSjpRGC5UwgeY Jun 16 12:46:53.439550 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jun 16 12:46:53.439550 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jun 16 12:46:53.439550 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jun 16 12:46:53.439550 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jun 16 12:46:53.439550 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jun 16 12:46:53.439550 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jun 16 12:46:53.439550 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Id: 150f43b9e49a48ee9b72066f07fe95c4 Jun 16 12:46:53.439550 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-TestVolumeBootPattern-1888988749 Jun 16 12:46:53.439550 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Role: member,reader Jun 16 12:46:53.439550 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Roles: member,reader Jun 16 12:46:53.441304 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/150f43b9e49a48ee9b72066f07fe95c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/150f43b9e49a48ee9b72066f07fe95c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_150f43b9e49a48ee9b72066f07fe95c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/150f43b9e49a48ee9b72066f07fe95c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Jun 16 12:46:53.441304 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-TestVolumeBootPattern-1888988749 Jun 16 12:46:53.441304 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant-Id: 150f43b9e49a48ee9b72066f07fe95c4 Jun 16 12:46:53.441304 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-TestVolumeBootPattern-1888988749 Jun 16 12:46:53.441304 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User: tempest-TestVolumeBootPattern-1888988749-project Jun 16 12:46:53.441304 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jun 16 12:46:53.441304 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jun 16 12:46:53.441304 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Id: 7cab259dbcb84995aadd366f599afa06 Jun 16 12:46:53.441304 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-TestVolumeBootPattern-1888988749-project Jun 16 12:46:53.441304 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: method: > Jun 16 12:46:53.441304 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: exception: Instance 2870520c-7049-4b01-8f69-f3c71edd419b could not be found. Jun 16 12:46:53.441304 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: action_args: {'id': '2870520c-7049-4b01-8f69-f3c71edd419b'} Jun 16 12:46:53.442412 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:46:53.442412 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:46:53.442412 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:46:53.442412 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:46:53.442412 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:46:53.442412 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:46:53.442412 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:46:53.442412 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:46:53.442412 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:46:53.442412 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:46:53.442412 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2870520c-7049-4b01-8f69-f3c71edd419b could not be found. Jun 16 12:46:53.442412 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:46:53.442412 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:46:53.442412 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:46:53.442412 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:46:53.442412 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:46:53.442412 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:46:53.442412 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:46:53.442412 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:46:53.442412 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:46:53.444047 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:46:53.444047 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 12:46:53.444047 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 12:46:53.444047 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:46:53.444047 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:46:53.444047 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:46:53.444047 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:46:53.444047 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2870520c-7049-4b01-8f69-f3c71edd419b could not be found. Jun 16 12:46:53.444047 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:46:53.444047 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:46:53.444047 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:46:53.444047 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:46:53.444047 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:46:53.444047 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:46:53.444047 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:46:53.444047 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:46:53.444047 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2870520c-7049-4b01-8f69-f3c71edd419b could not be found. Jun 16 12:46:53.444047 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:46:53.445817 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-54f9244f-cc9c-47fc-8c4f-122736a8a7a3 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Returning 404 to user: Instance 2870520c-7049-4b01-8f69-f3c71edd419b could not be found. {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:46:53.445817 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-54f9244f-cc9c-47fc-8c4f-122736a8a7a3 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "GET /compute/v2.1/servers/2870520c-7049-4b01-8f69-f3c71edd419b" status: 404 len: 111 microversion: 2.1 time: 0.029916 Jun 16 12:46:53.445817 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 613/1215] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:46:53 2022] GET /compute/v2.1/servers/2870520c-7049-4b01-8f69-f3c71edd419b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 12:46:53.881370 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d56114e9-9141-4b5b-bdc7-ed688742f83a tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:46:53.881861 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d56114e9-9141-4b5b-bdc7-ed688742f83a tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: 59e0a2bf-716d-4e85-8332-f5ca8ffac988] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:46:53.888437 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d56114e9-9141-4b5b-bdc7-ed688742f83a tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:46:53.888893 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d56114e9-9141-4b5b-bdc7-ed688742f83a tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:46:53.889656 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d56114e9-9141-4b5b-bdc7-ed688742f83a tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:46:53.890127 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d56114e9-9141-4b5b-bdc7-ed688742f83a tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:46:53.903309 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-d56114e9-9141-4b5b-bdc7-ed688742f83a tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] HTTP exception thrown: Instance 59e0a2bf-716d-4e85-8332-f5ca8ffac988 could not be found. Jun 16 12:46:53.904938 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d56114e9-9141-4b5b-bdc7-ed688742f83a tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Request method failure captured: Jun 16 12:46:53.904938 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: request: DELETE /compute/v2.1/servers/59e0a2bf-716d-4e85-8332-f5ca8ffac988 HTTP/1.1 Jun 16 12:46:53.904938 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 16 12:46:53.904938 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 16 12:46:53.904938 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Connection: close Jun 16 12:46:53.904938 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 16 12:46:53.904938 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 16 12:46:53.904938 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Host: 10.222.0.45 Jun 16 12:46:53.904938 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 16 12:46:53.904938 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 16 12:46:53.904938 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABiqyRCVe1nO68hUC5nq5ZPKCn6diHqewjzZl_C0p-GDE0Qhc-3c8ZV5ouJSCgffRyWnI2QsBhNAO7XnfqW1aXeSIvVyZcZugaGGH8Q96UIBSpSxOv54KQsxGK3lSGrnP1wKkKE85DLIY_AKghOggAiE6RcKLStKgScpvdSjpRGC5UwgeY Jun 16 12:46:53.904938 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 16 12:46:53.904938 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 16 12:46:53.904938 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 16 12:46:53.904938 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 16 12:46:53.904938 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 16 12:46:53.904938 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 16 12:46:53.904938 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Id: 150f43b9e49a48ee9b72066f07fe95c4 Jun 16 12:46:53.904938 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-TestVolumeBootPattern-1888988749 Jun 16 12:46:53.904938 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 16 12:46:53.904938 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 16 12:46:53.906750 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/150f43b9e49a48ee9b72066f07fe95c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/150f43b9e49a48ee9b72066f07fe95c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_150f43b9e49a48ee9b72066f07fe95c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/150f43b9e49a48ee9b72066f07fe95c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Jun 16 12:46:53.906750 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-TestVolumeBootPattern-1888988749 Jun 16 12:46:53.906750 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 150f43b9e49a48ee9b72066f07fe95c4 Jun 16 12:46:53.906750 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-TestVolumeBootPattern-1888988749 Jun 16 12:46:53.906750 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User: tempest-TestVolumeBootPattern-1888988749-project Jun 16 12:46:53.906750 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 16 12:46:53.906750 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 16 12:46:53.906750 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Id: 7cab259dbcb84995aadd366f599afa06 Jun 16 12:46:53.906750 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-TestVolumeBootPattern-1888988749-project Jun 16 12:46:53.906750 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: method: > Jun 16 12:46:53.906750 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: exception: Instance 59e0a2bf-716d-4e85-8332-f5ca8ffac988 could not be found. Jun 16 12:46:53.906750 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: action_args: {'id': '59e0a2bf-716d-4e85-8332-f5ca8ffac988'} Jun 16 12:46:53.908044 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:46:53.908044 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:46:53.908044 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:46:53.908044 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:46:53.908044 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:46:53.908044 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:46:53.908044 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:46:53.908044 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:46:53.908044 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:46:53.908044 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:46:53.908044 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59e0a2bf-716d-4e85-8332-f5ca8ffac988 could not be found. Jun 16 12:46:53.908044 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:46:53.908044 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:46:53.908044 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:46:53.908044 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:46:53.908044 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:46:53.908044 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:46:53.908044 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:46:53.908044 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:46:53.908044 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:46:53.909660 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:46:53.909660 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 12:46:53.909660 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 12:46:53.909660 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 12:46:53.909660 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 12:46:53.909660 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:46:53.909660 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:46:53.909660 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:46:53.909660 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:46:53.909660 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59e0a2bf-716d-4e85-8332-f5ca8ffac988 could not be found. Jun 16 12:46:53.909660 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:46:53.909660 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:46:53.909660 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:46:53.909660 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:46:53.909660 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:46:53.909660 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:46:53.909660 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:46:53.909660 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:46:53.909660 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59e0a2bf-716d-4e85-8332-f5ca8ffac988 could not be found. Jun 16 12:46:53.909660 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 16 12:46:53.911307 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d56114e9-9141-4b5b-bdc7-ed688742f83a tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Returning 404 to user: Instance 59e0a2bf-716d-4e85-8332-f5ca8ffac988 could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:46:53.911307 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d56114e9-9141-4b5b-bdc7-ed688742f83a tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "DELETE /compute/v2.1/servers/59e0a2bf-716d-4e85-8332-f5ca8ffac988" status: 404 len: 111 microversion: 2.1 time: 0.028962 Jun 16 12:46:53.911307 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 603/1216] 10.222.0.45 () {58 vars in 1238 bytes} [Thu Jun 16 12:46:53 2022] DELETE /compute/v2.1/servers/59e0a2bf-716d-4e85-8332-f5ca8ffac988 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 12:46:53.914854 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-186942a9-0e7a-42ac-adc2-f7aa55b436af tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:46:53.915470 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-186942a9-0e7a-42ac-adc2-f7aa55b436af tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] [instance: 59e0a2bf-716d-4e85-8332-f5ca8ffac988] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 12:46:53.921386 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-186942a9-0e7a-42ac-adc2-f7aa55b436af tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:46:53.921836 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-186942a9-0e7a-42ac-adc2-f7aa55b436af tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:46:53.923149 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-186942a9-0e7a-42ac-adc2-f7aa55b436af tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 12:46:53.923585 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-186942a9-0e7a-42ac-adc2-f7aa55b436af tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Lock "775f0c5f-83ba-4167-a2ea-1fd3bdd524cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 12:46:53.936962 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-186942a9-0e7a-42ac-adc2-f7aa55b436af tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] HTTP exception thrown: Instance 59e0a2bf-716d-4e85-8332-f5ca8ffac988 could not be found. Jun 16 12:46:53.939092 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-186942a9-0e7a-42ac-adc2-f7aa55b436af tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Request method failure captured: Jun 16 12:46:53.939092 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: request: GET /compute/v2.1/servers/59e0a2bf-716d-4e85-8332-f5ca8ffac988 HTTP/1.1 Jun 16 12:46:53.939092 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Accept: application/json Jun 16 12:46:53.939092 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jun 16 12:46:53.939092 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Connection: close Jun 16 12:46:53.939092 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jun 16 12:46:53.939092 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jun 16 12:46:53.939092 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Host: 10.222.0.45 Jun 16 12:46:53.939092 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jun 16 12:46:53.939092 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jun 16 12:46:53.939092 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABiqyRCVe1nO68hUC5nq5ZPKCn6diHqewjzZl_C0p-GDE0Qhc-3c8ZV5ouJSCgffRyWnI2QsBhNAO7XnfqW1aXeSIvVyZcZugaGGH8Q96UIBSpSxOv54KQsxGK3lSGrnP1wKkKE85DLIY_AKghOggAiE6RcKLStKgScpvdSjpRGC5UwgeY Jun 16 12:46:53.939092 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jun 16 12:46:53.939092 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jun 16 12:46:53.939092 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jun 16 12:46:53.939092 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jun 16 12:46:53.939092 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jun 16 12:46:53.939092 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jun 16 12:46:53.939092 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Id: 150f43b9e49a48ee9b72066f07fe95c4 Jun 16 12:46:53.939092 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-TestVolumeBootPattern-1888988749 Jun 16 12:46:53.939092 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Role: member,reader Jun 16 12:46:53.939092 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Roles: member,reader Jun 16 12:46:53.940825 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/150f43b9e49a48ee9b72066f07fe95c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/150f43b9e49a48ee9b72066f07fe95c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_150f43b9e49a48ee9b72066f07fe95c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/150f43b9e49a48ee9b72066f07fe95c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Jun 16 12:46:53.940825 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-TestVolumeBootPattern-1888988749 Jun 16 12:46:53.940825 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant-Id: 150f43b9e49a48ee9b72066f07fe95c4 Jun 16 12:46:53.940825 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-TestVolumeBootPattern-1888988749 Jun 16 12:46:53.940825 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User: tempest-TestVolumeBootPattern-1888988749-project Jun 16 12:46:53.940825 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jun 16 12:46:53.940825 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jun 16 12:46:53.940825 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Id: 7cab259dbcb84995aadd366f599afa06 Jun 16 12:46:53.940825 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-TestVolumeBootPattern-1888988749-project Jun 16 12:46:53.940825 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: method: > Jun 16 12:46:53.940825 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: exception: Instance 59e0a2bf-716d-4e85-8332-f5ca8ffac988 could not be found. Jun 16 12:46:53.940825 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: action_args: {'id': '59e0a2bf-716d-4e85-8332-f5ca8ffac988'} Jun 16 12:46:53.942047 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 12:46:53.942047 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:46:53.942047 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 12:46:53.942047 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 12:46:53.942047 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 12:46:53.942047 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 12:46:53.942047 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 12:46:53.942047 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 12:46:53.942047 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 12:46:53.942047 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 12:46:53.942047 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59e0a2bf-716d-4e85-8332-f5ca8ffac988 could not be found. Jun 16 12:46:53.942047 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:46:53.942047 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:46:53.942047 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:46:53.942047 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:46:53.942047 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:46:53.942047 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:46:53.942047 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 12:46:53.942047 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 12:46:53.942047 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 12:46:53.943659 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 12:46:53.943659 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 12:46:53.943659 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 12:46:53.943659 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 12:46:53.943659 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 12:46:53.943659 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 12:46:53.943659 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 12:46:53.943659 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59e0a2bf-716d-4e85-8332-f5ca8ffac988 could not be found. Jun 16 12:46:53.943659 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:46:53.943659 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 12:46:53.943659 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:46:53.943659 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 12:46:53.943659 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 12:46:53.943659 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 12:46:53.943659 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 12:46:53.943659 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 12:46:53.943659 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59e0a2bf-716d-4e85-8332-f5ca8ffac988 could not be found. Jun 16 12:46:53.943659 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 16 12:46:53.945189 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-186942a9-0e7a-42ac-adc2-f7aa55b436af tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Returning 404 to user: Instance 59e0a2bf-716d-4e85-8332-f5ca8ffac988 could not be found. {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 12:46:53.945189 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-186942a9-0e7a-42ac-adc2-f7aa55b436af tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "GET /compute/v2.1/servers/59e0a2bf-716d-4e85-8332-f5ca8ffac988" status: 404 len: 111 microversion: 2.1 time: 0.029369 Jun 16 12:46:53.945189 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 614/1217] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Jun 16 12:46:53 2022] GET /compute/v2.1/servers/59e0a2bf-716d-4e85-8332-f5ca8ffac988 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 12:46:55.230795 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e0575bc3-3780-4b2c-ab10-fd50fd5d3ed2 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] Calling method '.version_select at 0x7f7c7229dca0>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 12:46:55.254481 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e0575bc3-3780-4b2c-ab10-fd50fd5d3ed2 tempest-TestVolumeBootPattern-1888988749 tempest-TestVolumeBootPattern-1888988749-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-176952666" status: 202 len: 0 microversion: 2.1 time: 0.027453 Jun 16 12:46:55.255067 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 604/1218] 10.222.0.45 () {58 vars in 1259 bytes} [Thu Jun 16 12:46:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-176952666 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 12:48:26.878182 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 12:48:26.878717 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Thu Jun 16 12:48:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 12:48:52.153049 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 12:48:52.153800 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Thu Jun 16 12:48:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 12:50:05.572582 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 12:50:05.573183 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Thu Jun 16 12:50:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 12:50:10.087210 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 12:50:10.087875 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Thu Jun 16 12:50:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 12:51:46.886071 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 12:51:46.886592 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Thu Jun 16 12:51:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 12:52:02.976139 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 12:52:02.976687 dv-cinder-846149-2-iscsi devstack@n-api.service[117606]: Thu Jun 16 12:52:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 12:52:12.162206 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 12:52:12.162856 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Thu Jun 16 12:52:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 12:52:14.014906 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 12:52:14.016547 dv-cinder-846149-2-iscsi devstack@n-api.service[117607]: Thu Jun 16 12:52:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!